Generating enriched events using enriched data and extracted features

ABSTRACT

A method, system and computer-usable medium for constructing a distribution of interrelated event features. The constructing a distribution of interrelated event features includes receiving a stream of events, the stream of events comprising a plurality of events; extracting features from the plurality of events; constructing a distribution of the features from the plurality of events; and, analyzing the distribution of the features from the plurality of events.

BACKGROUND OF THE INVENTION Field of the Invention

The present invention relates in general to the field of computers andsimilar technologies, and in particular to software utilized in thisfield. Still more particularly, it relates to a method, system andcomputer-usable medium for analyzing probability distributions ofinterrelated event features.

Description of the Related Art

Users interact with physical, system, data, and services resources ofall kinds, as well as each other, on a daily basis. Each of theseinteractions, whether accidental or intended, poses some degree ofsecurity risk. However, not all behavior poses the same risk.Furthermore, determining the extent of risk corresponding to individualevents can be difficult.

However, not all user behavior poses the same risk. For example, a useraccessing an organization's proprietary resources poses a higher riskthan the same user perusing an online website during working hours.Consequently, indiscriminately applying the same policy to all userbehavior instead of adjusting security oversight accordingly may resultin inefficient utilization of security system resources. However,identifying what may be anomalous, abnormal, unexpected, or malicioususer behavior can often prove challenging, as such behavior may not bereadily apparent when employing typical security monitoring approaches.

SUMMARY OF THE INVENTION

A method, system and computer-usable medium for analyzing probabilitydistributions of interrelated event features in real-time.

More specifically, in one embodiment, the invention relates to a methodfor constructing a distribution of interrelated event features,comprising: receiving a stream of events, the stream of eventscomprising a plurality of events; extracting features from the pluralityof events; constructing a distribution of the features from theplurality of events; and, analyzing the distribution of the featuresfrom the plurality of events.

In another embodiment, the invention relates to a system comprising: aprocessor; a data bus coupled to the processor; and a non-transitory,computer-readable storage medium embodying computer program code, thenon-transitory, computer-readable storage medium being coupled to thedata bus, the computer program code interacting with a plurality ofcomputer operations and comprising instructions executable by theprocessor and configured for: receiving a stream of events, the streamof events comprising a plurality of events; extracting features from theplurality of events; constructing a distribution of the features fromthe plurality of events; and, analyzing the distribution of the featuresfrom the plurality of events.

In another embodiment, the invention relates to a non-transitory,computer-readable storage medium embodying computer program code, thecomputer program code comprising computer executable instructionsconfigured for: receiving a stream of events, the stream of eventscomprising a plurality of events; extracting features from the pluralityof events; constructing a distribution of the features from theplurality of events; and, analyzing the distribution of the featuresfrom the plurality of events.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention may be better understood, and its numerousobjects, features and advantages made apparent to those skilled in theart by referencing the accompanying drawings. The use of the samereference number throughout the several figures designates a like orsimilar element.

FIG. 1 depicts an exemplary client computer in which the presentinvention may be implemented;

FIG. 2 is a simplified block diagram of an edge device;

FIG. 3 is a simplified block diagram of an endpoint agent;

FIG. 4 is a simplified block diagram of a security analytics system;

FIG. 5 is a simplified block diagram of the operation of a securityanalytics system;

FIG. 6 is a generalized process flow diagram of the performance of eventenrichment operations;

FIG. 7 is a generalized process flow diagram of the performance of eventqueue analytics operations;

FIG. 8 is a simplified block diagram of the operation of a probabilitydistribution analysis system;

FIG. 9 is a generalized process flow diagram of the performance ofscoring container update operations;

FIG. 10 shows the probability density function (PDF) distribution ofcertain features over a series of time windows;

FIG. 11 is a generalized process flow diagram of the performance of datasearch and feature matching operations associated with the compilationof a query;

FIG. 12 is a generalized process flow diagram of the performance of lazymatching operations for a single, analyzed query;

FIG. 13 is a generalized process flow diagram of the performance of lazymatching operations for a mixed analyzed and non-analyzed query;

FIG. 14 is a generalized process flow diagram of the performance of lazymatching operations based upon a shared extractor;

FIG. 15 is a generalized process flow diagram of the performance of lazymatching operations performed with different lexical analyzers,

FIG. 16 is a generalized process flow diagram of the performance of lazymatching operations with reuse across queries,

FIGS. 17 a and 17 b are a generalized flowchart of the performance ofscoring container update operations; and

FIG. 18 shows the operation of a probability distribution analysissystem displayed within a user interface.

DETAILED DESCRIPTION

A method, system and computer-usable medium for analyzing probabilitydistributions of interrelated event features in real-time. Certainaspects of the invention reflect an appreciation that social behaviorover short time scales is frequently understood in terms of actions,which can be thought of as discrete events in which one individual emitsa behavior directed at one or more other entities in his or herenvironment, possibly including themselves. Certain aspects of theinvention likewise reflect an appreciation that the analysis of suchevents often includes the generation of probability distributions ofcertain associated items of interest, described in greater detailherein. Likewise, certain aspects of the invention reflect anappreciation that such analysis is often performed in batch mode, oron-demand, as opposed to being performed in real-time in a streamingenvironment.

For the purposes of this disclosure, an information handling system mayinclude any instrumentality or aggregate of instrumentalities operableto compute, classify, process, transmit, receive, retrieve, originate,switch, store, display, manifest, detect, record, reproduce, handle, orutilize any form of information, intelligence, or data for business,scientific, control, entertainment, or other purposes. For example, aninformation handling system may be a personal computer, a mobile devicesuch as a tablet or smartphone, a consumer electronic device, aconnected “smart device,” a network appliance, a network storage device,a network gateway device, a server or collection of servers or any othersuitable device and may vary in size, shape, performance, functionality,and price. The information handling system may include volatile and/ornon-volatile memory, and one or more processing resources such as acentral processing unit (CPU) or hardware or software control logic.Additional components of the information handling system may include oneor more storage systems, one or more wired or wireless interfaces forcommunicating with other networked devices, external devices, andvarious input and output (I/O) devices, such as a keyboard, a mouse, amicrophone, speakers, a track pad, a touchscreen and a display device(including a touch sensitive display device). The information handlingsystem may also include one or more buses operable to transmitcommunication between the various hardware components.

For the purposes of this disclosure, computer-readable media may includeany instrumentality or aggregation of instrumentalities that may retaindata and/or instructions for a period of time. Computer-readable mediamay include, without limitation, storage media such as a direct accessstorage device (e.g., a hard disk drive or solid state drive), asequential access storage device (e.g., a tape disk drive), opticalstorage device, random access memory (RAM), read-only memory (ROM),electrically erasable programmable read-only memory (EEPROM), and/orflash memory; as well as communications media such as wires, opticalfibers, microwaves, radio waves, and other electromagnetic and/oroptical carriers; and/or any combination of the foregoing.

FIG. 1 is a generalized illustration of an information handling system100 that can be used to implement the system and method of the presentinvention. The information handling system 100 includes a processor(e.g., central processor unit or “CPU”) 102, input/output (I/O) devices104, such as a display, a keyboard, a mouse, and associated controllers,a storage system 106, and various other subsystems 108. In variousembodiments, the information handling system 100 also includes networkport 110 operable to connect to a network 140, which is likewiseaccessible by a service provider server 142. The information handlingsystem 100 likewise includes system memory 112, which is interconnectedto the foregoing via one or more buses 114. System memory 112 furtherincludes operating system (OS) 116 and in various embodiments may alsoinclude a probability distribution analysis system 118. In oneembodiment, the information handling system 100 is able to download theprobability distribution analysis system 118 from the service providerserver 142. In another embodiment, the probability distribution analysissystem 118 is provided as a service from the service provider server142.

In various embodiments, the probability distribution analysis system 118performs a probability distribution analysis operation. In certainembodiments, the probability distribution analysis operation improvesprocessor efficiency, and thus the efficiency of the informationhandling system 100, by analyzing the probability distribution offeatures associated with certain interrelated events. As will beappreciated, once the information handling system 100 is configured toperform the probability distribution analysis operation, the informationhandling system 100 becomes a specialized computing device specificallyconfigured to perform the probability distribution analysis operationand is not a general purpose computing device. Moreover, theimplementation of the probability distribution analysis system 118 onthe information handling system 100 improves the functionality of theinformation handling system 100 and provides a useful and concreteresult of analyzing the probability distribution of features associatedwith certain interrelated events.

FIG. 2 is a simplified block diagram of an edge device implemented inaccordance with an embodiment of the invention. As used herein, an edgedevice, such as the edge device 202 shown in FIG. 2 , broadly refers toa device providing an entry point into a network 140. Examples of suchedge devices 202 may include routers, routing switches, integratedaccess devices (IADs), multiplexers, wide-area network (WAN) accessdevices, and network security appliances. In certain embodiments, thenetwork 140 may be a private network (e.g., an enterprise network), asemi-public network (e.g., a service provider core network), or a publicnetwork (e.g., the Internet).

Skilled practitioners of the art will be aware that edge devices 202 areoften implemented as routers that provide authenticated access tofaster, more efficient backbone and core networks. Furthermore, currentindustry trends include making edge devices 202 more intelligent, whichallows core devices to operate at higher speed as they are not burdenedwith additional administrative overhead. Accordingly, such edge devices202 often include Quality of Service (QoS) and multi-service functionsto manage different types of traffic. Consequently, it is common todesign core networks with switches that use routing protocols such asOpen Shortest Path First (OSPF) or Multiprotocol Label Switching (MPLS)for reliability and scalability. Such approaches allow edge devices 202to have redundant links to the core network, which not only providesimproved reliability, but enables enhanced, flexible, and scalablesecurity capabilities as well.

In certain embodiments, the edge device 202 may be implemented toinclude a communications/services architecture 204, various pluggablecapabilities 212, a traffic router 210, and a pluggable hostingframework 208. In certain embodiments, the communications/servicesarchitecture 202 may be implemented to provide access to and fromvarious networks 140, cloud services 206, or a combination thereof. Incertain embodiments, the cloud services 206 may be provided by a cloudinfrastructure familiar to those of skill in the art. In certainembodiments, the edge device 202 may be implemented to provide supportfor a variety of generic services, such as directory integration,logging interfaces, update services, and bidirectional risk/contextflows associated with various analytics. In certain embodiments, theedge device 202 may be implemented to provide temporal information,described in greater detail herein, associated with the provision ofsuch services.

In certain embodiments, the edge device 202 may be implemented as ageneric device configured to host various network communications, dataprocessing, and security management capabilities. In certainembodiments, the pluggable hosting framework 208 may be implemented tohost such capabilities in the form of pluggable capabilities 212. Incertain embodiments, the pluggable capabilities 212 may includecapability ‘1’ 214 (e.g., basic firewall), capability ‘2’ 216 (e.g.,general web protection), capability ‘3’ 218 (e.g., data sanitization),and so forth through capability ‘n’ 220, which may include capabilitiesneeded for a particular operation, process, or requirement on anas-needed basis. In certain embodiments, such capabilities may includethe performance of operations associated with analyzing the probabilitydistribution of features associated with certain interrelated events, asdescribed in greater detail herein. In certain embodiments, suchoperations may include the provision of associated temporal information(e.g., time stamps).

In certain embodiments, the pluggable capabilities 212 may be sourcedfrom various cloud services 206. In certain embodiments, the pluggablehosting framework 208 may be implemented to provide certain computingand communication infrastructure components, and foundationcapabilities, required by one or more of the pluggable capabilities 212.In certain embodiments, the pluggable hosting framework 208 may beimplemented to allow the pluggable capabilities 212 to be dynamicallyinvoked. Skilled practitioners of the art will recognize that many suchembodiments are possible. Accordingly, the foregoing is not intended tolimit the spirit, scope or intent of the invention.

FIG. 3 is a simplified block diagram of an endpoint agent implemented inaccordance with an embodiment of the invention. As used herein, anendpoint agent 306 broadly refers to a software agent used incombination with an endpoint device 304 to establish a protectedendpoint 302. Skilled practitioners of the art will be familiar withsoftware agents, which are computer programs that perform actions onbehalf of a user or another program. In various approaches, a softwareagent may be autonomous or work together with another agent or a user.In certain of these approaches the software agent is implemented toautonomously decide if a particular action is appropriate for a givenevent, such as an observed user behavior.

An endpoint device 304, as likewise used herein, refers to aninformation processing system such as a personal computer, a laptopcomputer, a tablet computer, a personal digital assistant (PDA), a smartphone, a mobile telephone, a digital camera, a video camera, or otherdevice that is capable of storing, processing and communicating data. Incertain embodiments, the communication of the data may take place inreal-time or near-real-time. As used herein, real-time broadly refers toprocessing and providing information within a time interval brief enoughto not be discernable by a user. As an example, a cellular phoneconversation may be used to communicate information in real-time, whilean instant message (IM) exchange may be used to communicate informationin near real-time. In certain embodiments, the communication of theinformation may take place asynchronously. For example, an email messagemay be stored on an endpoint device 304 when it is offline. In thisexample, the information may be communicated to its intended recipientonce the endpoint device 304 gains access to a network 140.

A protected endpoint 302, as likewise used herein, broadly refers to apolicy-based approach to network security that typically requiresendpoint devices 304 to comply with particular criteria before they aregranted access to network resources. As an example, a given endpointdevice 304 may be required to have a particular operating system (OS),or version thereof, a Virtual Private Network (VPN) client, anti-virussoftware with current updates, and so forth. In various embodiments, theprotected endpoint 302 may be implemented to perform operationsassociated with analyzing the probability distribution of featuresassociated with certain interrelated events, as described in greaterdetail herein. In various embodiments, the protected endpoint may beimplemented to collect and provide certain information associated withan event, described in greater detail herein. In certain embodiments,the protected endpoint 302 may be implemented to provide temporalinformation, such as timestamp information, associated with suchoperations.

In certain embodiments, the endpoint agent 306 may be implemented touniversally support a variety of operating systems, such as AppleMacintosh®, Microsoft Windows®, Linux®, Android® and so forth. Incertain embodiments, the endpoint agent 306 may be implemented tointeract with the endpoint device 304 through the use of low-level hooks312 at the OS level. It will be appreciated that the use of low-levelhooks 312 allows the endpoint agent 306 to subscribe to multiple eventsthrough a single hook. Consequently, multiple functionalities providedby the endpoint agent 306 can share a single data stream, using onlythose portions of the data stream they may individually need.Accordingly, system efficiency can be improved and operational overheadreduced.

In certain embodiments, the endpoint agent 306 may be implemented toprovide a common infrastructure for pluggable feature packs 308. Invarious embodiments, the pluggable feature packs 308 may provide certainsecurity management functionalities. Examples of such functionalitiesmay include various anti-virus and malware detection, data lossprotection (DLP), insider threat detection, and so forth. In certainembodiments, the security management functionalities may include one ormore functionalities associated with analyzing probability distributionsof interrelated event features in real time, as described in greaterdetail herein.

In certain embodiments, a particular pluggable feature pack 308 may beinvoked as needed by the endpoint agent 306 to provide a givenfunctionality. In certain embodiments, individual features of aparticular pluggable feature pack 308 are invoked as needed. It will beappreciated that the ability to invoke individual features of apluggable feature pack 308, without necessarily invoking all suchfeatures, will likely improve the operational efficiency of the endpointagent 306 while simultaneously reducing operational overhead.Accordingly, the endpoint agent 306 can self-optimize in certainembodiments by using the common infrastructure and invoking only thosepluggable components that are applicable or needed for a given userbehavior.

In certain embodiments, the individual features of a pluggable featurepack 308 may be invoked by the endpoint agent 306 according to theoccurrence of a particular user behavior. In certain embodiments, theindividual features of a pluggable feature pack 308 may be invoked bythe endpoint agent 306 according to the occurrence of a particularevent, described in greater detail herein. In certain embodiments, theindividual features of a pluggable feature pack 308 may be invoked bythe endpoint agent 306 at a particular point in time. In theseembodiments, the method by which a given user behavior, event, or pointin time is selected is a matter of design choice.

In certain embodiments, the individual features of a pluggable featurepack 308 may be invoked by the endpoint agent 306 according to thecontext of a particular user behavior. As an example, the context may bethe user enacting the user behavior, their associated riskclassification, which resource they may be requesting, the point in timethe user behavior is enacted, and so forth. In certain embodiments, thepluggable feature packs 308 may be sourced from various cloud services206. In certain embodiments, the pluggable feature packs 308 may bedynamically sourced from various cloud services 206 by the endpointagent 306 on an as-need basis.

In certain embodiments, the endpoint agent 306 may be implemented withadditional functionalities, such as event analytics 310. In certainembodiments, the event analytics 310 functionality may include analysisof various user behaviors, described in greater detail herein. Incertain embodiments, the event analytics 310 functionality may includeanalyzing the probability distribution of features associated withcertain interrelated events, as described in greater detail herein. Incertain embodiments, a particular event may in turn be associated withone or more user behaviors, likewise described in greater detail herein.

In certain embodiments, the endpoint agent 306 may be implemented with athin hypervisor 314, which can be run at Ring −1, thereby providingprotection for the endpoint agent 306 in the event of a breach. As usedherein, a thin hypervisor broadly refers to a simplified, OS-dependenthypervisor implemented to increase security. As likewise used herein,Ring −1 broadly refers to approaches allowing guest operating systems torun Ring 0 (i.e., kernel) operations without affecting other guests orthe host OS. Those of skill in the art will recognize that many suchembodiments and examples are possible. Accordingly, the foregoing is notintended to limit the spirit, scope or intent of the invention.

FIG. 4 is a simplified block diagram of a security analytics systemimplemented in accordance with an embodiment of the invention. Incertain embodiments, the security analytics system shown in FIG. 4 maybe implemented to provide log storage, reporting, and analytics capableof performing streaming 406 and on-demand 408 analytics operations. Incertain embodiments, such operations may be associated with defining andmanaging a user profile, as described in greater detail herein. Incertain embodiments, the security analytics system may be implemented toprovide a uniform platform for storing events and contextual informationassociated with various user behaviors and performing longitudinalanalytics.

As used herein, longitudinal analytics broadly refers to performinganalytics of user behaviors occurring over a particular period of time.As an example, a user may iteratively attempt to access certainproprietary information stored in various locations. In addition, theattempts may occur over a brief period of time. To continue the example,the fact that the information the user is attempting to access isproprietary, that it is stored in various locations, and the attemptsare occurring in a brief period of time, in combination, may indicatethe user behavior enacted by the user is suspicious. As another example,certain entity identifier information (e.g., a user name) associatedwith a user may change over time. In this example, the change in username, during a particular period of time or at a particular point intime, may represent suspicious user behavior.

In certain embodiments, the security analytics system may be implementedto be scalable. In certain embodiments, the security analytics systemmay be implemented in a centralized location, such as a corporate datacenter. In these embodiments, additional resources may be added to thesecurity analytics system as needs grow. In certain embodiments, thesecurity analytics system may be implemented as a distributed system. Inthese embodiments, the security analytics system may span multipleinformation processing systems. In certain embodiments, the securityanalytics system may be implemented in a cloud environment. In certainembodiments, the security analytics system may be implemented in avirtual machine (VM) environment. In such an embodiment, the VMenvironment may be configured to dynamically and seamlessly scale thesecurity analytics system as needed. Skilled practitioners of the artwill recognize that many such embodiments are possible. Accordingly, theforegoing is not intended to limit the spirit, scope or intent of theinvention.

In certain embodiments, an event collector 402 may be implemented tocollect event and contextual information, described in greater detailherein, associated with various user behaviors. In these embodiments,the method by which the event and contextual information collected bythe event collector 402 is selected to be collected is a matter ofdesign choice. In certain embodiments, the event and contextualinformation collected by the event collector 402 may be processed by anenrichment module 404 to generate enriched user behavior information. Incertain embodiments, the enrichment may include certain contextualinformation related to a particular user behavior. In certainembodiments, the enrichment may include certain temporal information,such as timestamp information, related to a particular user behavior.

In certain embodiments, enriched user behavior information may beprovided by the enrichment module 404 to a streaming 406 analyticsmodule. In turn, the streaming 406 analytics module may provide some orall of the enriched user behavior information to an on-demand 408analytics module. As used herein, streaming 406 analytics broadly refersto analytics performed in near real-time on enriched user behaviorinformation as it is received. Likewise, on-demand 408 analytics broadlyrefers herein to analytics performed, as it is requested, on enricheduser behavior information after it has been received. In certainembodiments, the enriched user behavior information may be associatedwith a particular event. In certain embodiments, the enrichment 404 andstreaming analytics 406 modules may be implemented to perform eventqueue analytics 420 operations, as described in greater detail herein.

In certain embodiments, the on-demand 408 analytics may be performed onenriched user behavior associated with a particular interval of, orpoint in, time. In certain embodiments, the streaming 406 or on-demand408 analytics may be performed on enriched user behavior associated witha particular user, group of users, one or more entities, or acombination thereof. In certain embodiments, the streaming 406 oron-demand 408 analytics may be performed on enriched user behaviorassociated with a particular resource, such as a facility, system,datastore, or service. Those of skill in the art will recognize thatmany such embodiments are possible. Accordingly, the foregoing is notintended to limit the spirit, scope or intent of the invention.

In certain embodiments, the results of various analytics operationsperformed by the streaming 406 or on-demand 408 analytics modules may beprovided to a storage Application Program Interface (API) 412. In turn,the storage API 412 may be implemented to provide access to variousdatastores ‘1’ 414 through ‘n’ 416, which in turn are used to store theresults of the analytics operations. In certain embodiments, thesecurity analytics system may be implemented with a logging andreporting front-end 410, which is used to receive the results ofanalytics operations performed by the streaming 406 analytics module. Incertain embodiments, the datastores ‘1’ 414 through ‘n’ 416 mayvariously include a datastore of entity identifiers, temporal events, ora combination thereof.

In certain embodiments, the security analytics system may be implementedto provide a risk management service 418. In certain embodiments, therisk management service 418 may be implemented to perform operationsassociated with defining and managing a user profile, as described ingreater detail herein. In certain embodiments, the risk managementservice 418 may be implemented to provide the results of variousanalytics operations performed by the streaming 406 or on-demand 408analytics modules. In certain embodiments, the risk management service418 may be implemented to use the storage API 412 to access variousenhanced cyber behavior and analytics information stored on thedatastores ‘1’ 414 through ‘n’ 416. Skilled practitioners of the artwill recognize that many such embodiments are possible. Accordingly, theforegoing is not intended to limit the spirit, scope or intent of theinvention.

FIG. 5 is a simplified block diagram of the operation of a securityanalytics system implemented in accordance with an embodiment of theinvention. In certain embodiments, the security analytics system 512 maybe implemented to perform operations associated with analyzing theprobability distribution of features associated with certaininterrelated events, as described in greater detail herein. In certainembodiments, the security analytics system 512 may be implemented incombination with one or more endpoint agents 306, one or more edgedevices 202, cloud services 206, a security analytics system 512, and anetwork 140 to perform such operations.

In certain embodiments, the network edge device 202 may be implementedin a bridge, a firewall, or a passive monitoring configuration. Incertain embodiments, the edge device 202 may be implemented as softwarerunning on an information processing system. In certain embodiments, thenetwork edge device 202 may be implemented to provide integratedlogging, updating and control. In certain embodiments, the edge device202 may be implemented to receive network requests and context-sensitivecyber behavior information in the form of enriched cyber behaviorinformation 510, described in greater detail herein, from an endpointagent 306, likewise described in greater detail herein.

In certain embodiments, the security analytics system 512 may beimplemented as both a source and a sink of user behavior information. Incertain embodiments, the security analytics system 512 may beimplemented to serve requests for user/resource risk data. In certainembodiments, the edge device 202 and the endpoint agent 306,individually or in combination, may provide certain user behaviorinformation to the security analytics system 512 using either push orpull approaches familiar to skilled practitioners of the art.

As described in greater detail herein, the edge device 202 may beimplemented in certain embodiments to receive enriched user behaviorinformation 510 from the endpoint agent 306. It will be appreciated thatsuch enriched user behavior information 510 will likely not be availablefor provision to the edge device 202 when an endpoint device 304 is notimplemented for a corresponding endpoint agent 306. However, the lack ofsuch enriched user behavior information 510 may be accommodated invarious embodiments, albeit with reduced functionality related tooperations associated with defining and managing a user profile.

In certain embodiments, a given user behavior may be enriched by anassociated endpoint agent 306 attaching contextual information to arequest. In certain embodiments, the context is embedded within anetwork request, which is then provided as enriched user behaviorinformation 510. In certain embodiments, the contextual information maybe concatenated, or appended, to a request, which in turn may beprovided as enriched user behavior information 510. In theseembodiments, the enriched user behavior information 510 may be unpackedupon receipt and parsed to separate the request and its associatedcontextual information. Those of skill in the art will recognize thatone possible disadvantage of such an approach is that it may perturbcertain Intrusion Detection System and/or Intrusion Detection Prevention(IDS/IDP) systems implemented on a network 140.

In certain embodiments, new flow requests may be accompanied by acontextual information packet sent to the edge device 202. In theseembodiments, the new flow requests may be provided as enriched userbehavior information 510. In certain embodiments, the endpoint agent 306may also send updated contextual information to the edge device 202 onceit becomes available. As an example, an endpoint agent 306 may share alist of files that have been read by a current process at any point intime once the information has been collected. To continue the example,such a list of files may be used to determine which data the endpointagent 306 may be attempting to exfiltrate.

In certain embodiments, point analytics processes executing on the edgedevice 202 may request a particular service. As an example, risk scoreson a per-user basis may be requested. In certain embodiments, theservice may be requested from the security analytics system 512. Incertain embodiments, the service may be requested from various cloudservices 206.

In certain embodiments, contextual information associated with a userbehavior may be attached to various network service requests. In certainembodiments, the request may be wrapped and then handled by proxy. Incertain embodiments, a small packet of contextual information associatedwith a user behavior may be sent with a service request. In certainembodiments, service requests may be related to Domain Name Service(DNS), web browsing activity, email, and so forth, all of which areessentially requests for service by an endpoint device 304. In certainembodiments, such service requests may be associated with temporal eventinformation, described in greater detail herein. Consequently, suchrequests can be enriched by the addition of user behavior contextualinformation (e.g., UserAccount, interactive/automated, data-touched,temporal event information, etc.). Accordingly, the edge device 202 canthen use this information to manage the appropriate response tosubmitted requests.

In certain embodiments, the security analytics system 512 may beimplemented in different operational configurations. In certainembodiments, the security analytics system 512 may be implemented byusing the endpoint agent 306. In certain embodiments, the securityanalytics system 512 may be implemented by using endpoint agent 306 incombination with the edge device 202. In certain embodiments, the cloudservices 206 may likewise be implemented for use by the endpoint agent306, the edge device 202, and the security analytics system 512,individually or in combination. In these embodiments, the securityanalytics system 512 may be primarily oriented to performing riskassessment operations related to user actions, program actions, dataaccesses, or a combination thereof. In certain embodiments, programactions may be treated as a proxy for the user.

In certain embodiments, the endpoint agent 306 may be implemented toupdate the security analytics system 512 with user behavior andassociated contextual information, thereby allowing an offload ofcertain analytics processing overhead. In certain embodiments, thisapproach allows for longitudinal risk scoring, which assesses riskassociated with certain user behavior during a particular interval oftime. In certain embodiments, the security analytics system 512 may beimplemented to access risk scores associated with the same user account,but accrued on different endpoint devices 304. It will be appreciatedthat such an approach may prove advantageous when an adversary is“moving sideways” through a network environment, using differentendpoint devices 304 to collect information.

In certain embodiments, the security analytics system 512 may beprimarily oriented to applying risk mitigations in a way that maximizessecurity effort return-on-investment (ROI). In certain embodiments, thisapproach may be accomplished by providing additional contextual and userbehavior information associated with user requests. As an example, a webgateway may not concern itself with why a particular file is beingrequested by a certain entity at a particular point in time.Accordingly, if the file cannot be identified as malicious or harmless,there is no context available to determine how, or if, to proceed. Toextend the example, the edge device 202 and security analytics system512 may be coupled such that requests can be contextualized and fittedinto a framework that evaluates their associated risk. It will beappreciated that such an embodiment works well with web-based data lossprotection (DLP) approaches, as each transfer is no longer examined inisolation, but in the broader context of an identified user's actions,at a particular time, on the network 140.

As another example, the security analytics system 512 may be implementedto perform risk scoring processes to decide whether to block or allowunusual flows. It will be appreciated that such an approach is highlyapplicable to defending against point-of-sale (POS) malware, a breachtechnique that has become increasingly more common in recent years. Itwill likewise be appreciated that while various edge device 202implementations may not stop all such exfiltrations, they may be able tocomplicate the task for the attacker.

In certain embodiments, the security analytics system 512 may beprimarily oriented to maximally leverage contextual informationassociated with various user behaviors within the system. In certainembodiments, data flow tracking is performed by one or more endpointagents 306, which allows the quantity and type of information associatedwith particular hosts to be measured. In turn, this information may beused to determine how the edge device 202 handles requests. Bycontextualizing such user behavior on the network 140, the securityanalytics system 512 can provide intelligent protection, makingdecisions that make sense in the broader context of an organization'sactivities. It will be appreciated that one advantage to such anapproach is that information flowing through an organization, and thenetworks they employ, should be trackable, and substantial data breachespreventable. Skilled practitioners of the art will recognize that manysuch embodiments and examples are possible. Accordingly, the foregoingis not intended to limit the spirit, scope or intent of the invention.

FIG. 6 is a generalized process flow diagram of the performance of eventenrichment operations implemented in accordance with an embodiment ofthe invention. As used herein, an event broadly refers to the occurrenceof an action performed by an entity. In certain embodiments, the actionmay be directly associated with a user behavior, described in greaterdetail herein. As an example, a first user may attach a binary fileinfected with a virus to an email that is subsequently sent to a seconduser. In this example, the act of attaching the binary file to the emailis directly associated with a user behavior enacted by the first user.In certain embodiments, the action may be indirectly associated with auser behavior. To extend the example, the recipient of the email mayopen the infected binary file, and as a result, infect their computerwith malware. To continue the example, the act of opening the infectedbinary file is directly associated with a user behavior enacted by thesecond user. However, the infection of the email recipient's computer bythe infected binary file is indirectly associated with the describeduser behavior enacted by the second user.

As likewise used herein, an entity broadly refers to something thatexists as itself, whether physically or abstractly. In certainembodiments, an entity may be an individual user, a group, anorganization, or a government. In certain embodiments, an entity maylikewise be an item, a device, such as endpoint and edge devices, anetwork, a domain, an operation, or a process. In certain embodiments,an entity may be a resource, such as a geographical location orformation, a physical facility, a venue, a system, a data store, or aservice, such as a service operating in a cloud environment.

In certain embodiments, event stream enrichment operations 600 may beinitiated by individual events in an event stream 602 being received andprocessed by various event enrichment modules to generate enrichedevents 610. As used herein, event enrichment broadly refers toperforming certain data enrichment operations and processes associatedwith enriching data associated with a particular event in the eventstream 602. As likewise used herein, data enrichment broadly refers tovarious operations and processes typically used to enhance, refine orotherwise improve raw data.

Examples of geographic data enrichment may include the use of postalcode, county name, longitude and latitude, and political district data,while examples of behavioral data enrichment may include purchase,credit risk, and preferred communication channel data. Likewise,examples of demographic data enrichment may include the use of income,marital status, and education data, while examples of psychographic dataenrichment may include interests and political affiliation data.

In certain embodiments, event enrichment may include matching certainincoming events in the event stream 602 with existing event data. Incertain embodiments, event enrichment may include deleting certain dataassociated with certain incoming events in the event stream 602. Forexample, certain data associated with various incoming events may bedetermined to be irrelevant to analyzing the probability distributionsof certain interrelated event features. In certain embodiments, themethod by which data associated with various incoming events isdetermined to be irrelevant is a matter of design choice.

In certain embodiments, event enrichment may include correcting invaliddata associated with certain incoming events in the event stream 602. Incertain embodiments, event enrichment may include interpolating dataassociated with certain incoming events in the event stream 602 withexisting event data. In certain embodiments, the existing event data maybe stored in a repository of persistent event data.

For example, an event in the event stream 602 may be associated with afirst user attaching a binary file to an email addressed to a seconduser. In this example, the event enrichment operations 600 may includedetermining the file type of the attachment. Likewise, the eventenrichment operations 600 may include determining the size of theattachment, the date and time of the email, the address of theoriginating email server, the email addresses of the first and seconduser, and so forth. In certain embodiments, the event enrichmentoperations 600 may include associating annotations or other metadatacorresponding to such determinations with the event.

In certain embodiments, the event enrichment modules may include anevent validator module 604. In certain embodiments, the event validator604 module may be implemented to perform data validation operations ondata associated with a particular event. As used herein, data validationbroadly refers to various operations and processes associated with datacleansing to ensure data quality. As likewise used herein, datacleansing broadly refers to the process of detecting, correcting, andpossible removing, corrupted or inaccurate elements from a data set. Incertain embodiments, data cleansing operations may include identifyingincomplete, incorrect, inaccurate, or irrelevant data elements and thenreplacing, modifying or deleting certain data elements that fail to meetcertain data use parameters.

In certain embodiments, the event validator 604 module may beimplemented to perform data validation operations without the use ofstatistical data. In certain embodiments, the event validator 604 modulemay be implemented to validate event timestamps fall within a particularinterval of time. In certain embodiments, the interval of time may beuser-defined or otherwise configurable. In these embodiments, thedefinition of the interval of time is a matter of design choice. Incertain embodiments, the event validator 604 module may be implementedsuch that an alias for an entity does not exceed a certain number ofcharacters. In these embodiments, the number of characters is a matterof design choice. In certain embodiments, the event validator 604 modulemay be implemented that any attested metadata has an expected,corresponding type. In these embodiments, the expected type of metadatais a matter of design choice.

In certain embodiments, the resulting validated event data may beconsistent with similar data sets used by a probability distributionanalysis system to analyze the probability distribution of featuresassociated with certain interrelated events. Certain embodiments of theinvention reflect an appreciation that the intent of such datavalidation is to ensure fitness, accuracy and consistency of dataassociated with a particular event. Certain embodiments of the inventionlikewise reflect an appreciation that such fitness, accuracy andconsistency is advantageous when performing operations associated withanalyzing the probability distribution of features associated withcertain interrelated events.

In certain embodiments, the event enrichment modules may include ade-duplication 606 module. In certain embodiments, the de-duplication606 module may be implemented to perform operations associated withde-duplication. As used herein, de-duplication operations broadly referto operations for determining a unique identity for an event based uponcertain identifying fields. In certain embodiments, the identifyingfields may include an externally-generated concept, idea or notionprovided by the data source from which the event originated. In variousembodiments, the identifying fields may include certain fields deemed tobe fundamental to the identity of an event, or identification thereof.In certain embodiments, the value of an identifying field may be takenas imprecise with configurable granularity. For example, events thatappear to be similar, and have timestamps within one minute of oneanother, may be considered duplicates.

As likewise used herein, entity resolution operations broadly refer tooperations for resolving certain raw identifiers in input data to knownentities. In certain embodiments, the known entities may be used by aprobability distribution analysis system for analyzing probabilitydistributions of interrelated event features. Likewise, as used herein,attachment enrichment operations broadly refer to operations for addingmetadata based upon the quantity or type of data associated with anevent. In certain embodiments, the metadata may be determined byextension, mime type headers, or mime type, as inferred from contentassociated with an event. As used herein, domain enrichment operationsbroadly refer to operations for adding metadata based upon configurablecategorizations of domains of entity identifiers associated with theevent. In certain embodiments, the metadata may be used to categorizethe event as internal or external to an organization, a particularbusiness unit, government agency, and so forth.

In certain embodiments, the event enrichment modules may likewiseinclude a content isolation 608 module. In certain embodiments, thecontent isolation 608 module may be implemented to recognize and isolatecertain types of recurring content. Examples of such recurring contentmay include standardized text, such as disclaimers or various types ofboilerplate. Other examples of recurring content may include graphicalimages such as logos, icons, user avatars, and so forth. Certainembodiments of the invention reflect an appreciation that the inclusionof such recurring content in certain probability distribution analysesmay result in an inaccurate representation of the probabilitydistribution of features associated with a particular event.Accordingly, certain embodiments of the invention may not includecontent that has been isolated by the content isolation 608 module whenperforming various probability distribution analysis operations,described in greater detail herein.

FIG. 7 is a generalized process flow diagram of the performance of eventqueue analytics operations implemented in accordance with an embodimentof the invention. In various embodiments, a probability distributionanalysis system may be implemented to process certain entity informationassociated with an event to analyze the probability distribution of itsassociated features. As used herein, entity information broadly refersto information that can be used to ascertain or corroborate the identityof an entity and its associated behavior, whether the behavior occurswithin a physical realm or cyberspace. In certain embodiments, entityinformation may include user profile attributes, user behavior factors,or user mindset factors, described in greater detail herein. In variousembodiments, entity information may include certain types of content. Incertain embodiments, such content may include text, unstructured data,structured data, graphical images, photographs, audio recordings, videorecordings, biometric information, and so forth. In certain embodiments,the entity information may include metadata. In certain embodiments, themetadata may include entity attributes, which in turn may includecertain entity identifier types or classifications.

In various embodiments, the probability distribution analysis system maybe implemented to use certain entity identifier information to ascertainthe identity of an associated entity at a particular point in time. Asused herein, entity identifier information broadly refers to aninformation element associated with an entity that can be used toascertain or corroborate the identity of its corresponding entity at aparticular point in time. In certain embodiments, the entity identifierinformation may include user authentication factors, user profileattributes, user behavior factors, user mindset factors, informationassociated with various endpoint and edge devices, networks, resources,or a combination thereof.

In certain embodiments, the entity identifier information may includetemporal information. As used herein, temporal information broadlyrefers to a measure of time (e.g., a date, timestamp, etc.), a measureof an interval of time (e.g., a minute, hour, day, etc.), or a measureof an interval of time (e.g., between Jun. 3, 2017 and Mar. 4, 2018,etc.). In certain embodiments, the temporal information may beassociated with an event associated with a particular point in time. Asused herein, such a temporal event broadly refers to an occurrence,action or activity enacted by, or associated with, an entity at aparticular point in time.

Examples of such temporal events include making a phone call, sending atext or an email, using a device, such as an endpoint device, accessinga system, and entering a physical facility. Other examples of temporalevents include uploading, transferring, downloading, modifying, ordeleting data, such as data stored in a datastore, or accessing aservice. Yet other examples of temporal events include interactionsbetween two or more users, interactions between a user and a device,interactions between a user and a network, and interactions between auser and a resource, whether physical or otherwise. Yet still otherexamples of temporal events include a change in name, address, physicallocation, occupation, position, role, marital status, gender,association, affiliation, or assignment.

As likewise used herein, temporal event information broadly refers totemporal information associated with a particular event. In variousembodiments, the temporal event information may include certain types ofcontent. In certain embodiments, such types of content may include text,unstructured data, structured data, graphical images, photographs, audiorecordings, video recordings, and so forth. In certain embodiments, theentity information may include metadata. In various embodiments, themetadata may include temporal event attributes, which in turn mayinclude certain entity identifier types or classifications, described ingreater detail herein.

In certain embodiments, the probability distribution analysis system maybe implemented to use information associated with such temporalresolution of an entity's identity to assess the risk associated with aparticular entity, at a particular point in time, and adaptively respondwith an associated response. In certain embodiments, the probabilitydistribution analysis system may be implemented to respond to suchassessments in order to reduce operational overhead and improve systemefficiency while maintaining security integrity. In certain embodiments,the response to such assessments may be performed by a securityadministrator. Accordingly, certain embodiments of the invention may bedirected towards assessing the risk associated with the affirmativeresolution of the identity of an entity at a particular point in time incombination with its associated contextual information. Consequently,the probability distribution analysis system may be more oriented invarious embodiments to risk adaptation than to security administration.

As used herein, a probability distribution broadly refers to amathematical function that provides the probabilities of occurrence ofdifferent possible outcomes within a sample space. In certainembodiments, the probability distribution is defined by a probabilitydistribution function. In certain embodiments, the probabilitydistribution function may be implemented as a probability densityfunction, a probability mass function, or a cumulative distributionfunction. A sample space, as likewise used herein, broadly refers to theset of all possible outcomes of a particular phenomenon being observed.In certain embodiments, the phenomenon being observed may be an event,described in greater detail herein. In certain embodiments, thephenomenon being observed is a matter of design choice.

As likewise used herein, a probability density function (PDF), ordensity of a continuous random variable, broadly refers to a functionwhose value at any given sample within a particular sample space can beinterpreted as providing a relative likelihood that the value of therandom variable would equal that sample. A probability mass function(PMF), as used herein, broadly refers to a function that gives theprobability that a discrete random variable is exactly equal to aparticular value. A cumulative distribution function (CDF), as likewiseused herein, broadly refers to a function whose value is the probabilitythat a corresponding continuous random variable, described in greaterdetail herein, has a value less than or equal to the argument of thefunction.

In certain embodiments, one or more probability distribution functionsmay be implemented to describe the distribution of multivariate randomvariables. In certain embodiments, one or more probability distributionfunctions may be implemented to determine the relative unlikelihood thatthe value of a random variable would equal a particular sample. Incertain embodiments, the relative unlikelihood that the value of arandom variable would equal a particular sample may be classified as anoutlier. In certain embodiments, the method by which a particular samplemay be classified as an outlier is a matter of design choice. As anexample, a particular sample that is more than two standard deviationsfrom the mean of a PDF distribution may be considered to be an outlier.Likewise, a particular sample that is more than one standard deviationfrom the mean of a PDF distribution may be considered to be an outlier.

In certain embodiments, the sample may be the occurrence of a featureassociated with a corresponding event. As used herein, a feature, as itrelates to an event, broadly refers to a property, characteristic orattribute of a particular event. As an example, features associated witha corpus of thousands of text-oriented messages (e.g., SMS, email,social network messages, etc.) may be generated by removing low-valuewords (i.e., stopwords), using certain size blocks of words (i.e.,n-grams), or applying various text processing rules. Examples offeatures associated with an event may include the number of bytesuploaded, the time of day, the presence of certain terms in unstructuredcontent, the respective domains associated with senders and recipientsof information, and the Uniform Resource Locator (URL) classification ofcertain web page visits.

In certain embodiments, such features may be associated with anomalous,abnormal, unexpected or malicious user behavior, as described in greaterdetail herein. In certain embodiments, the occurrence of an unlikelyfeature or features associated with a particular entity may result inthe generation of a corresponding risk score. In certain embodiments,the generation of a corresponding risk score may include computing theaggregation of occurrences of certain unlikely features with which anentity may be associated. In certain embodiments, the resulting riskscore may be assigned, or otherwise associated, with the entityassociated with the occurrence of an unlikely feature. In certainembodiments, the assigned risk score may be implemented to reflect asecurity risk corresponding to the entity associated with the occurrenceof the unlikely feature. In certain embodiments, multiple occurrences ofan unlikely feature within a particular period of time may increase anassigned risk score.

In certain embodiments, the event queue analytics operations may beimplemented to determine whether or not a particular document matches aset of queries 704 defined in a Domain Specific Language (DSL). Incertain embodiments, the DSL query 704 may reference data, metadata, ora combination thereof, related to an event. In certain embodiments, theDSL query 704 may be expressed in a DSL specific to the domain oftemporal events involving the data, metadata, or a combination relatedto such events. As used herein, a document broadly refers to a body ofcontent. In certain embodiments, such content may include text,unstructured data, structured data, graphical images, photographs, audiorecordings, video recordings, biometric information, metadata, and soforth. As likewise used herein, a Domain Specific Language (DSL) broadlyrefers to a computer language specialized to a particular applicationdomain. Examples of DSLs include Hypertext Mark-up Language (HTML) forweb pages. Mathematica® for symbolic mathematics, Structured QueryLanguage (SQL) for relational database queries, and Query DSL (QDSL) forElasticsearch queries.

Referring now to FIG. 7 , enriched events 610 resulting from performanceof the event enrichment operations 600 described in the text associatedwith FIG. 6 may be provided in certain embodiments to a DSL queryprocessing 702 module. In certain embodiments, the DSL query processing702 module may be implemented to provide a streaming query framework. Incertain embodiments, the streaming query framework may be implemented toextract features, as described in greater detail herein, and constructprobability distributions in real-time, in batch mode, or on-demand. Incertain embodiments, the DSL query processing 702 module may beimplemented to receive certain DSL queries 704 that include terms,features, tags, or other items of interest that may be associated withcertain interrelated events. As used herein, a term broadly refers to aword, compound word, phrase expression, numeric value, or alphanumericstring, which in certain contexts is associated with a particularmeaning. As used herein, a phrase broadly refers to a sequence of terms,or multi-words, familiar to skilled practitioners of the art. In certainembodiments, a term may be associated with an event, a feature of anevent, a classification label, a metadata tag label, or a combinationthereof.

In certain embodiments, the DSL query processing 702 module may beimplemented to determine the commonalities between such DSL queries 704.In certain embodiments, the DSL query processing 702 module may beimplemented to lazily evaluate such features, terms, or phrases ofinterest, as described in greater detail herein. In certain embodiments,as likewise described in greater detail herein, the DSL query processing702 module may be implemented only evaluate the features or other termsof interest needed for the evaluation of a particular event. In certainembodiments, the DSL query processing 702 module may be implemented toonly evaluate the features or other terms of interest once whenperforming multiple queries.

In certain embodiments, the queries may only be processed when the DSLquery processing 702 module is first initialized. In certain embodimentsthe queries 704 may be reprocessed periodically by the DSL queryprocessing 702 module during event collection if they have been added toor otherwise changed. In certain embodiments, such reprocessing may beperformed by periodically polling for configuration changes andreinitializing the DSL query processing 702 module as needed. Certainembodiments of the invention reflect an appreciation that suchreinitializing of the DSL query processing 702 module facilitates thereduction of a DSL query 704, which involves executing preliminary querysteps against reference data. In certain embodiments, the reference datamay be stored in a secondary repository (not shown), whichcross-references the event data using identifiers searchable within arepository of persistent event data 770.

As an example, a DSL query 704 may be for events associated withemployees whose salary is greater than some amount. In this example, thefirst step is to identify who those employees may be, and once they areidentified, include them into the query when it is “reduced.” It will beappreciated that the use of cached results in place of taking this stepmay result in missing an employee who recently received a raise, and asa result, belongs in the group of identified employees. It will likewisebe appreciated that inclusion in the group of identified employees wouldtypically not occur until the DSL query processing 702 module wasreinitialized. In certain embodiments, the DSL query processing 702module may be implemented to periodically recompile and re-reducecertain DSL queries 704. In these embodiments, the method by which thedecision is made to periodically recompile and re-reduce DSL queries 704is a matter of design choice.

In certain embodiments, the receipt of a DSL query 704 may result incertain apply labels initialization 706 operations being performed toinitialize an apply labels 708 module. In certain embodiments, the applylabels 708 module may be implemented to classify events received fromthe DSL query processing 702 module by labeling them with associatedclassification labels. In certain embodiments, the labels applied by theapply labels 708 module may include associated metadata tags. In theseembodiments, the method by which the apply labels 708 module selects aclassification or metadata tag label, and the associated nomenclaturethereof, is a matter of design choice.

As an example, an event may include a user downloading a file from aparticular server address. In this example, the event may be classifiedas a “file download” with corresponding metadata of “server address.”Accordingly, the apply labels 614 module may apply both a “filedownload” classification label and a “server address” metadata tag labelto the event. As another example, an event may include an employee usinga badge to enter a secured facility after normal work hours. In thisexample, the event may be classified as “facility access,” withcorresponding metadata of “secure” and “after hours.” Accordingly, theapply labels 708 module may apply a “facility access” classificationlabel as well as “secure” and “after hours” metadata tag labels to theevent.

In certain embodiments, the labels applied by the apply labels 708module may be user-generated, user-edited, or a combination thereof. Invarious embodiments, certain labels applied by the apply labels 708module may be applied automatically, corresponding to certain sets ofconditions. In certain embodiments, the labels applied by the applylabels 708 module may be automatically or manually removed from certaininterrelated events, based on inspection. In certain embodiments, thelabels applied by the apply labels 708 module to one event mayautomatically or manually be added to another event. In certainembodiments, such addition of labels may be based upon a query toprovide bulk labeling of certain interrelated events that may sharecommon features or other characteristics. In various embodiments, suchaddition of labels may be implemented to flag certain interrelatedevents as part of a review workflow. In certain embodiments, the applylabels operations performed by the apply labels 708 module may result inconfigured features. In certain embodiments, the receipt of a DSL query704 may result in certain features initialization 710 operations beingperformed to initialize a feature matching 712 module. In certainembodiments, labeled events generated by the apply labels 708 module maybe processed by the feature matching 712 module to generate matchedfeatures. In certain embodiments, the feature matching 712 module may beimplemented to perform certain feature extraction operations on theconfigured featured generated by the apply labels 708 module.

As likewise used herein, feature extraction broadly refers to theselection of a subset of features associated with an event. In certainembodiments, the feature matching 712 module may be implemented toperform transformation operations on a group of features associated withan event to generate a smaller set of derived features. In certainembodiments, the feature matching 714 module may be implemented toconstruct derived probabilistic models based upon a particular group offeatures. In certain embodiments, certain features may be aggregated,from which the derived probabilistic models may be constructed. Incertain embodiments, the resulting derived probabilistic models may beaggregated into a scenario. As used herein, a scenario is broadlydefined as a group of derived probabilistic models associated with acorresponding group of interrelated events.

Certain embodiments of the invention reflect an appreciation that thegeneration of derived features may be advantageous as various featuresassociated with a particular event may represent a non-linear pattern orrelationship. Likewise, having too many features that may share similarattributes may result in multicollinearity or otherwise confound certainstatistical models. Accordingly, the performance of certain featureextraction operations to extract a minimal number of derived featuresmay result in more accurately determining the probability distributionof associated features corresponding to a particular event. In certainembodiments, the feature matching 712 module may be implemented to usecertain scoring data stored in a repository of persistent scoring data768, or event data stored in a repository of persistent event data 770,or a combination thereof, to perform the feature extraction operations.

In certain embodiments, scoring container update operations, describedin greater detail herein, may be initiated by the performance of certainscoring container initialization 714 operations to initialize a featurescoring 716 module. In certain embodiments, the scoring containerinitialization 714 operations may be initiated by the performance ofcertain features initialization 710 operations. In certain embodiments,the scoring container initialization 712 module may be implemented todetermine whether feature matching operations, likewise described ingreater detail herein, should be performed on a particular configuredfeature.

In certain embodiments, the determination of whether or not featurematching operations are performed may be dependent upon on the type ofthe feature. In certain embodiments, the type of the feature may bedetermined by an associated feature definition. In these embodiments,the method by which a feature definition is defined, determined, orassociated with a corresponding feature is a matter of design choice.

In certain embodiments, events are not inspected prior to initializingthe a scoring container. In certain embodiments, a repository ofpersistent event data 770 may be queried for a random sampling of eventscontaining particular configured features. In certain embodiments, theresulting random sampling of events may be used during various scoringcontainer initialization 714 operations to generate an initialprobability distribution of their associated features. In certainembodiments, the initial probability distribution of associated featuresmay likewise be stored in the repository of persistent event data 770for re-use.

If so, then feature matching operations, described in greater detailherein, are performed on the extracted feature by a feature matching 712module. If not, or once the feature matching operations are performed bythe feature matching 712 module, scoring operations, likewise describedin greater detail herein, are performed on the configured feature by afeature scoring 716 module. In certain embodiments, performance ofcertain feature scoring operations by the feature scoring 706 moduleresults in the generation of scored features 720. In certainembodiments, the scored features may be stored in the repository ofpersistent event data 770.

FIG. 8 is a simplified block diagram of the operation of a probabilitydistribution analysis system implemented in accordance with anembodiment of the invention. In certain embodiments, the probabilitydistribution analysis system 118 may be implemented to analyze theprobability distribution of features associated with certaininterrelated events. In certain embodiments, such events may beassociated with a user, such as user ‘A’ 802 or ‘B’ 862. In certainembodiments, analyses performed by the probability distribution analysissystem 118 may be used to identify anomalous, abnormal, unexpected ormalicious behavior associated with a user. In certain embodiments, theanomalous, abnormal, unexpected or malicious behavior may be identifiedat a particular point in time, during the occurrence of an event, theenactment of a user behavior, or a combination thereof.

In certain embodiments, information associated with such user behaviormay be stored in a user profile. As used herein, a user profile broadlyrefers to a collection of information that uniquely describes a user'sidentity and their associated behavior, whether the behavior occurswithin a physical realm or cyberspace. In certain embodiments, asdescribed in greater detail herein, the user profile may include userprofile attributes 812, user behavior factors 814, user mindset factors828, or a combination thereof.

As used herein, a user profile attribute 812 broadly refers to data ormetadata that can be used, individually or in combination with otheruser profile attributes 812, to uniquely ascertain the identity of auser. In certain embodiments, the user profile attributes 812 mayinclude certain personal information. In certain embodiments, thepersonal information may include non-sensitive personal informationassociated with a user, such as their name, title, position, role, andresponsibilities. In certain embodiments, the personal information maylikewise include technical skill level information, peer information,expense account information, paid time off (PTO) information, dataanalysis information, insider information, misconfiguration information,third party information, or a combination thereof.

In certain embodiments, the personal information may contain sensitivepersonal information associated with a user. As used herein, sensitivepersonal information (SPI), also commonly referred to as personallyidentifiable information (PII), broadly refers to any information usableto ascertain the identity of a user, either by itself, or in combinationwith other information, such as contextual information described ingreater detail herein. Examples of SPI may include the full or legalname of a user, initials or nicknames, place and date of birth, home andbusiness addresses, personal and business telephone numbers, theirgender, and other genetic information.

Additional examples of SPI may include government-issued identifiers,such as a Social Security Number (SSN) or a passport number, vehicleregistration plate and serial numbers, and driver's license numbers.Other examples of SPI may include certain email addresses and socialmedia identifiers, credit and debit card numbers, and other digitalidentity information. Yet other examples of SPI may includeemployer-issued identifiers, financial transaction information, creditscores, electronic medical records (EMRs), insurance claim information,personal correspondence, and so forth. Further examples of SPI mayinclude user authentication factors 804, such as biometrics 806, tokens808, user identifiers and passwords 810, and personal identificationnumbers (PINs).

In certain embodiments, the user authentication factors 804 may be usedto authenticate the identity of a user, such as user ‘A’ 802 or ‘B’ 862.In certain embodiments, the user authentication factors 806 may be usedto ensure that a particular user, such as user ‘A’ 802 or ‘B’ 862, isassociated with their corresponding user profile, rather than a userprofile associated with another user. In certain embodiments, the userauthentication factors 804 may include a user's biometrics 806, anassociated security token 808, (e.g., a dongle containing cryptographickeys), or a user identifier/password (ID/PW) 810.

In certain embodiments, the user authentication factors 804 may be usedin combination to perform multi-factor authentication of a user, such asuser ‘A’ 802 or ‘B’ 862. As used herein, multi-factor authenticationbroadly refers to approaches requiring two or more authenticationfactors. In general, multi-factor authentication includes three classesof user authentication factors 804. The first is something the userknows, such as a user ID/PW 810. The second is something the userpossesses, such as a security token 808. The third is something that isinherent to the user, such as a biometric 806.

In certain embodiments, multi-factor authentication may be extended toinclude a fourth class of factors, which includes one or more userbehavior factors 814, or portions thereof. In these embodiments, thefourth class of factors may include user behavior the user haspreviously enacted, is currently enacting, or is expected to enact atsome point in the future. In certain embodiments, the enactment of auser behavior may be associated with a particular event. In certainembodiments, multi-factor authentication may be performed on recurringbasis. In various embodiments, the multi-factor authentication may beperformed at certain time intervals during the enactment of a particularuser behavior. In certain embodiments, the time interval may be uniform.In certain embodiments, the time interval may vary or be random.

In certain embodiments, the multi-factor authentication may be performedaccording to the occurrence of an event or the enactment of a particularuser behavior, such as accessing a resource 850. In various embodiments,certain combinations of the multi-factor authentication described hereinmay be used according to the enactment of a particular user behavior.From the foregoing, those of skill in the art will recognize that theaddition of such a fourth class of factors not only strengthens currentmulti-factor authentication approaches, but further, allows the factorsto be more uniquely associated with a given user and their correspondinguser profile.

Those of skill in the art will be aware that it is not uncommon forhackers, criminals and other actors to use various SPI to impersonate auser in order to gain unauthorized access to various systems, data, orfacilities. It is likewise not uncommon for such individuals tomasquerade as a user in order to collect their associated SPI for thepurpose of identity theft. One known approach to gathering a user's SPIis to illicitly capture a data stream, such as a flow of network packetsthat include SPI sent by a user to another machine, such as an externalsystem 880. Defenses against such approaches include encrypting the datastream prior to its communication across a network, such as the internal844 or external 846 networks shown in FIG. 8 .

However, other approaches, such as the use of a key logger, maysurreptitiously capture the user's keystrokes or user gestures 826,described in greater detail herein, and communicate the resulting datastream in their native form to a hacker or other infiltrator. Anotherissue is the possibility that a normally-trusted insider, such as asecurity administrator 868, may have access to a decrypted data streamas part of their day-to-day responsibilities. As an example, a securityadministrator 868 may be using a security analytics 512 system toperform threat analysis related to a particular user. In the process,they may be exposed to various SPI associated with the user, such ascertain user IDs and passwords 810. It will be appreciated that suchexposure creates the opportunity for a security breach, whether intendedor not. Another approach is to impersonate a legitimate website. In suchapproaches, the user may navigate to the site and innocently enter theirID/password 810, only to have them captured for later use in illegalactivities.

As used herein, a user behavior factor 814 broadly refers to informationassociated with a user's behavior, whether the behavior occurs within aphysical realm or cyberspace. In certain embodiments, user behaviorfactors 814 may include the user's access rights 816, the user'sinteractions 818, and the date/time/frequency 820 of when theinteractions 818 are enacted. In certain embodiments, the user behaviorfactors 814 may likewise include the user's location 824, and thegestures 826 used to enact the interactions 818.

In certain embodiments, the user gestures 826 may include key strokes ona keypad, a cursor movement, a mouse movement or click, a finger swipe,tap, or other hand gesture, an eye movement, or some combinationthereof. In certain embodiments, the user gestures 826 may likewiseinclude the cadence of the user's keystrokes, the motion, force andduration of a hand or finger gesture, the rapidity and direction ofvarious eye movements, or some combination thereof. In certainembodiments, the user gestures 826 may include various audio or verbalcommands performed by the user.

In various embodiments, certain date/time/frequency 820 behavior factors814 may be implemented as ontological or societal time, or a combinationthereof. As used herein, ontological time broadly refers to how oneinstant in time relates to another in a chronological sense. As anexample, a first user behavior enacted at 12:00 noon on May 17, 2017 hasoccurred prior to a second user behavior enacted at 6:39 PM on May 18,2018. Skilled practitioners of the art will recognize one value ofontological time is to determine the order in which various userbehaviors have been enacted.

As likewise used herein, societal time broadly refers to the correlationof certain user profile attributes 812, user behavior factors 814, usermindset factors 828, or a combination thereof, to one or more instantsin time. As an example, user ‘A’ 802 may access a system 854 to downloada customer list at 3:47 PM on Nov. 3, 2017. Analysis of their userbehavior profile indicates that it is not unusual for user ‘A’ 802 todownload the customer list on a weekly basis. However, examination oftheir user behavior profile also indicates that user ‘A’ 802 forwardedthe downloaded customer list in an email message to user ‘B’ 862 at 3:49PM that same day. Furthermore, there is no record in their user behaviorprofile that user ‘A’ 802 has ever communicated with user ‘B’ 862 in thepast. Moreover, it may be determined that user ‘B’ 862 is employed by acompetitor. Accordingly, the correlation of user ‘A’ 802 downloading thecustomer list at one point in time, and then forwarding the customerlist to user ‘B’ 862 at a second point in time shortly thereafter, is anexample of societal time.

In a variation of the prior example, user ‘A’ 802 may download thecustomer list at 3:47 PM on Nov. 3, 2017. However, instead ofimmediately forwarding the customer list to user ‘B’ 862, user ‘A’ 802leaves for a two week vacation. Upon their return, they forward thepreviously-downloaded customer list to user ‘B’ 862 at 9:14 AM on Nov.20, 2017. From an ontological time perspective, it has been two weekssince user ‘A’ 802 accessed a system 854 to download the customer list.However, from a societal time perspective, they have still forwarded thecustomer list to user ‘B’ 862, despite two weeks having elapsed sincethe customer list was originally downloaded.

Accordingly, the correlation of user ‘A’ 802 downloading the customerlist at one point in time, and then forwarding the customer list to user‘B’ 862 at a much later point in time, is another example of societaltime. More particularly, it may be inferred that the intent of user ‘A’802 did not changed during the two weeks they were on vacation.Furthermore, user ‘A’ 802 may have attempted to mask an intendedmalicious act by letting some period of time elapse between the timethey originally downloaded the customer list and when they eventuallyforwarded it to user ‘B’ 862. From the foregoing, those of skill in theart will recognize that the use of societal time may be advantageous indetermining whether a particular user behavior is acceptable, anomalous,abnormal, unexpected or malicious.

As used herein, mindset factors 828 broadly refer to information used todetermine the mental state of a user at a particular point in time,during the occurrence of an event or an enactment of a user behavior, orcombination thereof. As used herein, mental state broadly refers to ahypothetical state corresponding to the way a user may be thinking orfeeling. In certain embodiments, the user mindset factors 828 mayinclude a personality type. Examples of known approaches for determininga personality type 624 include Jungian types, Myers-Briggs typeindicators, Keirsy Temperament Sorter, Socionics, Enneagram ofPersonality, and Eyseneck's three-factor model.

In certain embodiments, the mindset factors 828 may include variousbehavioral biometrics. As likewise used herein, a behavioral biometricbroadly refers to a physiological indication of a user's mental state.Examples of behavioral biometrics may include a user's blood pressure,heartrate, respiratory rate, eye movements and iris dilation, facialexpressions, body language, tone and pitch of voice, speech patterns,and so forth.

Certain embodiments of the invention reflect an appreciation thatcertain user behavior factors 814, such as user gestures 826, mayprovide additional information related to determining a user's mentalstate. As an example, a user entering text at a quick pace with arhythmic cadence may indicate intense focus. Likewise a userintermittently entering text with forceful keystrokes may indicate theuser is in an agitated state. As another example, the user mayintermittently enter text somewhat languorously, which may indicatebeing in a thoughtful or reflective state of mind. As yet anotherexample, the user may enter text with a light touch with an unevencadence, which may indicate the user is hesitant or unsure of what isbeing entered.

Certain embodiments of the invention likewise reflect an appreciationthat while the user gestures 826 may indicate the mental state of auser, they may not provide the reason for the user to be in a particularmental state. Likewise, certain embodiments of the invention include anappreciation that certain user gestures 826 and behavioral biometricsare reflective of a user's personality type. As an example, aggressive,forceful keystrokes combined with an increased heart rate may indicatenormal behavior for a particular user when composing end-of-monthperformance reviews. In various embodiments, certain user behaviorfactors 814, such as user gestures 826, may be correlated with certaincontextual information.

As used herein, contextual information broadly refers to anyinformation, directly or indirectly, individually or in combination,related to a particular user behavior. In certain embodiments, userbehavior may include a user's physical behavior, cyber behavior, or acombination thereof. As likewise used herein, a user's physical behaviorbroadly refers to any user behavior occurring within a physical realm,such as speaking, gesturing, facial patterns or expressions, walking,and so forth. More particularly, such physical behavior may include anyaction enacted by a user that can be objectively observed, or indirectlyinferred, within a physical realm. In certain embodiments, the objectiveobservation, or indirect inference, of the physical behavior may beperformed electronically.

As an example, a user may attempt to use an electronic access card toenter a secured building at a certain time. In this example, the use ofthe access card to enter the building is the action and the reading ofthe access card makes the user's physical behaviorelectronically-observable. As another example, a first user mayphysically transfer a document to a second user, which is captured by avideo surveillance system. In this example, the physical transferal ofthe document from the first user to the second user is the action.Likewise, the video record of the transferal makes the first and seconduser's physical behavior electronically-observable. As used herein,electronically-observable user behavior broadly refers to any behaviorexhibited or enacted by a user that can be observed through the use ofan electronic device (e.g., an electronic sensor), a computing device orsystem (e.g., an endpoint device 304), computer instructions (e.g., asoftware application), or a combination thereof.

Cyber behavior, as used herein, broadly refers to any behavior occurringin cyberspace, whether enacted by an individual user, a group of users,or a system acting at the behest of an individual user, a group ofusers, or an entity. More particularly, cyber behavior may includephysical, social, or mental actions that can be objectively observed, orindirectly inferred, within cyberspace. As an example, a user may use anendpoint device 304 to access and browse a particular website on theInternet. In this example, the individual actions performed by the userto access and browse the website constitute a cyber behavior. As anotherexample, a user may use an endpoint device 304 to download a data filefrom a particular system at a particular point in time. In this example,the individual actions performed by the user to download the data file,and associated temporal information, such as a time-stamp associatedwith the download, constitute a cyber behavior. In these examples, theactions are enacted within cyberspace, in combination with associatedtemporal information, which makes them electronically-observable.

As likewise used herein, cyberspace broadly refers to a networkenvironment, such as an internal 844 or external 846 network, capable ofsupporting communication between two or more entities. In certainembodiments, the entity may be a user, an endpoint device 304, orvarious resources, described in greater detail herein. In certainembodiments, the entities may include various endpoint devices 304 orresources 850 operating at the behest of an entity, such as a user. Incertain embodiments, the communication between the entities may includeaudio, image, video, text, or binary data.

In certain embodiments, the contextual information may include a user'sauthentication factors 804. In certain embodiments, contextualinformation may likewise include various user identity resolutionfactors, such as personal information associated with the user, thedate/time/frequency 820 of various user behavior, the user's location824, the user's role or position in an organization, their associatedaccess rights 816, and certain user gestures 826 employed by the user inthe enactment of a user behavior. Other contextual information maylikewise include various user interactions, whether the interactions arewith an endpoint device 304, a network 140, a resource 850, or anotheruser. In certain embodiments, user behaviors, and their relatedcontextual information, may be collected at particular points ofobservation, and at particular points in time, described in greaterdetail herein.

In certain embodiments, a user profile may be processed with associatedcontextual information to generate correlated contextual information. Incertain embodiments, the correlated contextual information, along with auser's user profile, may be used to perform certain user behavioranalysis. In certain embodiments, the user behavior analysis may beperformed by the security analytics system 512. In certain embodiments,the security analytics system 512 may be implemented to process a userprofile and certain correlated contextual information associated with auser to determine their mental state at a particular point in time. Incertain embodiments, the mental state of a user at a particular point intime may be used in combination with various user profile attributes 812and user behavior factors 814, in the context of an associated userstate, to infer a user's intent.

In certain embodiments, a user profile may be used with a first set ofcontextual information to determine the user's mental state at a firstpoint in time and a second set of contextual information to determinetheir mental state at a second point in time. In certain embodiments,the user's mental state at a first point in time may correspond to theoccurrence of a first user event and the user's mental state at a secondpoint in time may correspond to the occurrence of a second user event.Certain embodiments of the invention reflect an appreciation that such afirst and second set of contextual information may be decidedlydifferent, which may provide context for the user's mental state atdifferent times and during the occurrence of different user events.Likewise, the first and second set of contextual information may besubstantively the same, which may provide an indication that while theuser's mental state may be different at two points in time, or duringthe occurrence of two different user events, the cause of their mentalstate may not be related to the contextual information that wascollected at the two points in time.

It will be appreciated that over time, the user behavior of a particularuser, such as user ‘A’ 802, will be uniquely different and distinct fromanother user, such as user ‘B’ 862. Accordingly, user profile ‘1’ willuniquely reflect the user behavior of user ‘1’, just as user profile ‘n’will uniquely reflect the user behavior of user ‘n’. As an example, user‘A’ 802 may have a user profile attribute 812 of sales administrator.Upon arriving at their office in the morning, the user consistentlychecks their email, item by item, responding to each in turn, followedby processing expense reports for field sales personnel. Then, afterlunch, the user may access and review sales forecasts on an internalsystem 854. Furthermore, the user may exhibit sporadic keyboard entryinterspersed with extensive mouse activity, or user gestures 826, whenperusing the sales forecasts.

Moreover, personality type information associated with user ‘A’ 802 mayindicate the user consistently exhibits a positive, outgoing attitude.In this example, the sequence of the activities enacted by user ‘A’ 802throughout the day, and their frequency, correspond to their expecteddate/time/frequency 820 user behavior factors 814. Likewise, thekeyboard cadence and other user gestures 826 are examples of granularuser behavior factors 814, while the personality type information is anexample of an abstract user behavior factor 814.

As another example, user ‘B’ 862 may have a user profile attribute 812of financial controller. Upon arriving at their office in the morning,the user usually scans their email messages, responding only to thosethat are urgent. Then they check the daily budget status of eachdepartment to see whether they are conforming to their respectiveguidelines. After lunch, the user may follow up on emails that are lessurgent, followed by updating the organization's financials, likewise onan internal system 854. Additionally, user ‘B’ 862 may exhibitdeliberate keyboard entry interspersed with iterative mouse activity, oruser gestures 826, when updating financial information. Moreover,personality type information associated with user ‘B’ 862 may indicatethey consistently exhibit a reserved, introspective and contemplativeattitude. As in the prior example, the sequence of the activitiesenacted by user ‘B’ 862 throughout the day, and their frequency,correspond to their expected date/time/frequency 820 user behaviorfactors 814. Likewise, as before, the keyboard cadence and other usergestures 826 are examples of granular user behavior factors 814, whilethe personality type information is an example of an abstract userbehavior factor 814.

It will likewise be appreciated that the user behavior of a particularuser may evolve over time. As an example, certain user behaviorexhibited by a user during the first month of assuming a new positionwithin an organization may be quite different than the user behaviorexhibited after being in the position for six months. To continue theexample, the user may be somewhat tentative when learning to access andinteract with unfamiliar resources 850 in the first month in theposition, but by the sixth month, such access and interaction iscommonplace and routine.

In certain embodiments, a user behavior factor 814 associated with aparticular user, such as user ‘A’ 802 or ‘B’ 862, may be used by theprobability distribution analysis system 118 to compare the user'scurrent user behavior to past user behavior. If the user's current userbehavior matches their past user behavior, then the probabilitydistribution analysis system 118 may determine that the user's userbehavior is acceptable. If not, then the user profile management system118 may determine that the user's user behavior is anomalous, abnormal,unexpected or malicious.

However, as described in greater detail herein, a change in a particularuser's user behavior over time may not be anomalous, abnormal,unexpected, or malicious. Instead, it may be acceptable behavior thatsimply evolves over time as a natural result of day-to-day user/device830, user/network 842, user/resource 848, or user/user 860 interactions.In certain embodiments, the probability distribution analysis system 118may be implemented to determine whether such changes in a user's userbehavior over time are acceptable, anomalous, abnormal, unexpected ormalicious. In certain embodiments, a user behavior profile may beimplemented in combination with the probability distribution analysissystem 118 to make this temporal determination.

It will be appreciated that anomalous, abnormal, unexpected or malicioususer behavior may include inadvertent or compromised user behavior. Forexample, the user may have innocently miss-entered a request for datathat is proprietary to an organization. As another example, the user maybe attempting to access confidential information as a result of beingcompromised. As yet another example, a user may attempt to accesscertain proprietary data from their home, over a weekend, and late atnight. In this example, the user may be working from home on a projectwith an impending deadline. Accordingly, the attempt to access theproprietary data is legitimate, yet still anomalous, abnormal orunexpected as the attempt did not occur during the week, from the user'splace of employment, during normal work hours. However, the userbehavior may manifest in context with consistent remote access patternsand provide sufficient evidence to determine the nature of the activity.

Likewise, the probability distribution analysis system 118 may determinethat the user's user behavior to be malicious. As yet another example,an impostor may be attempting to pose as a legitimate user in an attemptto exploit one or more resources 850. In this example, the attempt toexploit one or more resources 850 is malicious user behavior. As yetstill another example, a legitimate user may be attempting to increasetheir level of access to one or more resources 850. In this example, theuser's attempt to increase their level of access may indicate malicioususer behavior.

To further extend these examples, such resources 850 may include variousfacilities 852, systems 854, data stores 856, or services 858. Incertain embodiments, the probability distribution analysis system 118may be implemented to block a user if it is determined their userbehavior is anomalous, abnormal, unexpected or malicious. In certainembodiments, the probability distribution analysis system 118 may beimplemented to modify a request submitted by a user if it is determinedthe request is anomalous, abnormal, unexpected or malicious. In certainembodiments, the probability distribution analysis system 118 may beimplemented to modify an outcome. For example, the probabilitydistribution analysis system 118 may encrypt a file when a copyoperation or request is detected.

In certain embodiments, the user profile may be implemented as acyberprofile. A cyberprofile, as used herein, broadly refers to acollection of information that uniquely describes an entity and theirassociated behavior within cyberspace. In certain embodiments, theprobability distribution analysis system 118 may be implemented to useinformation associated with certain user behavior elements to define andmanage a user profile. A user behavior element, as used herein, broadlyrefers to a discrete element of a user's behavior during the performanceof a particular operation, or the occurrence of a particular event, in aphysical realm, cyberspace, or a combination thereof. In certainembodiments, such user behavior elements may be associated with auser/device 830, a user/network 842, a user/resource 848, a user/user860 interaction, or combination thereof.

As an example, user ‘A’ 802 may use an endpoint device 304 to browse aparticular web page on a news site on the Internet. In this example, theindividual actions performed by user ‘A’ 802 to access the web page areuser behavior elements that constitute a user behavior. As anotherexample, user ‘A’ 802 may use an endpoint device 304 to download a datafile from a particular system 854. In this example, the individualactions performed by user ‘A’ 802 to download the data file, includingthe use of one or more user authentication factors 804 for userauthentication, are user behavior elements that constitute a userbehavior. In certain embodiments, the user/device 830 interactions mayinclude an interaction between a user, such as user ‘A’ 802 or ‘B’ 862,and an endpoint device 304.

In certain embodiments, the user/device 830 interaction may includeinteraction with an endpoint device 304 that is not connected to anetwork at the time the interaction occurs. As an example, user ‘A’ 802or ‘B’ 862 may interact with an endpoint device 304 that is offline,using applications 832, accessing data 834, or a combination thereof, itmay contain. Those user/device 830 interactions, or their result, may bestored on the endpoint device 304 and then be accessed or retrieved at alater time once the endpoint device 304 is connected to the internal 844or external 846 networks.

In certain embodiments, the endpoint device 304 may be used tocommunicate data through the use of an internal network 844, an externalnetwork 846, or a combination thereof. In certain embodiments, theinternal 844 and the external 846 networks may include a public network,such as the Internet, a physical private network, a virtual privatenetwork (VPN), or any combination thereof. In certain embodiments, theinternal 844 and external 846 networks may likewise include a wirelessnetwork, including a personal area network (PAN), based on technologiessuch as Bluetooth. In various embodiments, the wireless network mayinclude a wireless local area network (WLAN), based on variations of theIEEE 802.11 specification, commonly referred to as WiFi. In certainembodiments, the wireless network may include a wireless wide areanetwork (WWAN) based on an industry standard including various 3G, 4Gand 5G technologies.

In certain embodiments, the user/resource 848 interactions may includeinteractions with various resources 850. In certain embodiments, theresources 850 may include various facilities 852 and systems 854, eitherof which may be physical or virtual, as well as data stores 856 andservices 858. In certain embodiments, the user/user 860 interactions mayinclude interactions between two or more users, such as user ‘A’ 802 and‘B’ 862. In certain embodiments, the user/user interactions 860 may bephysical, such as a face-to-face meeting, via a user/device 830interaction, a user/network 842 interaction, a user/resource 848interaction, or some combination thereof.

In certain embodiments, the user/user 860 interaction may include aface-to-face verbal exchange between two users. In certain embodiments,the user/user 860 interaction may include a written exchange, such astext written on a sheet of paper, between two users. In certainembodiments, the user/user 860 interaction may include a face-to-faceexchange of gestures, such as a sign language exchange, between twousers. In certain embodiments, temporal event information associatedwith various interactions 830, 842, 848, 860 may be collected and usedto define and manage a user profile.

In certain embodiments, the probability distribution analysis system 118may be implemented to observe user behavior at one or more points ofobservation within a physical domain or cyberspace environment. Incertain embodiments, the points of observation may occur during varioususer interactions, such as user/device 830, user/network 842,user/resource 848, and user/user 860 interactions described in greaterdetail herein. As an example, a user/user 860 interaction may include aninteraction between user ‘A’ 802 and ‘B’ 862.

In certain embodiments, the point of observation may include cyberbehavior of various kinds within an internal 844 network. As an example,the cyber behavior within an internal 844 network may include a useraccessing a particular internal system 854 or data store 856. In certainembodiments, the point of observation may include cyber behavior ofvarious kinds within an external 846 network. As an example, the cyberbehavior within an external 846 network may include a user's socialmedia activities or participation in certain user forums. Those of skillin the art will recognize that many such examples of user/device 830,user/network 842, user/resource 848, and user/user 860 interactions arepossible. Accordingly, the foregoing is not intended to limit thespirit, scope or intent of the invention.

In certain embodiments, the probability distribution analysis system 118may be implemented to process certain contextual information toascertain the identity of an entity at a particular point in time. Incertain embodiments, the contextual information may include locationdata 836. In certain embodiments, the endpoint device 304 may beconfigured to receive such location data 836, which is used as a datasource for determining the user's location 824.

In certain embodiments, the location data 836 may include GlobalPositioning System (GPS) data provided by a GPS satellite 838. Incertain embodiments, the location data 836 may include location data 836provided by a wireless network, such as from a cellular network tower840. In certain embodiments (not shown), the location data 836 mayinclude various Internet Protocol (IP) or other network addressinformation assigned to the endpoint 304 or edge 202 device. In certainembodiments (also not shown), the location data 836 may includerecognizable structures or physical addresses within a digital image orvideo recording.

In certain embodiments, the endpoint devices 304 may include an inputdevice (not shown), such as a keypad, magnetic card reader, tokeninterface, biometric sensor, digital camera, video surveillance camera,and so forth. In certain embodiments, such endpoint devices 304 may bedirectly, or indirectly, connected to a particular facility 852 orsystem 854. As an example, the endpoint device 304 may be directlyconnected to an ingress/egress system, such as an electronic lock on adoor or an access gate of a parking garage. As another example, theendpoint device 304 may be indirectly connected to a physical securitymechanism through a dedicated security network.

In certain embodiments, the probability distribution analysis system 118may be implemented as a stand-alone system. In certain embodiments, theprobability distribution analysis system 118 may be implemented as adistributed system. In certain embodiment, the probability distributionanalysis system 118 may be implemented as a virtual system, such as aninstantiation of one or more virtual machines (VMs). In certainembodiments, the probability distribution analysis system 118 may beimplemented to use various event data stored in a repository ofpersistent event data 770 to perform certain probability distributionanalyses, described in greater detail herein.

In certain embodiments, the probability distribution analysis system 118may be implemented to perform event queue analytics 420 operations,likewise described in greater detail herein. In certain embodiments, theprobability distribution analysis system 118 may be implemented as aprobability distribution analysis service 864. In certain embodiments,the probability distribution analysis service 864 may be implemented ina cloud environment familiar to those of skill in the art. Those ofskill in the art will recognize that many such embodiments are possible.Accordingly, the foregoing is not intended to limit the spirit, scope orintent of the invention.

FIG. 9 is a generalized process flow diagram of the performance ofscoring container update operations implemented in accordance with anembodiment of the invention. Skilled practitioners of the art will befamiliar with the concept of containers, which in typical use are aclass, a data structure, or an abstract data class whose instances are acollection of other objects. As such, they are used to store objects inan organized way according to certain access rules. In typicalimplementations, the size of a particular container is dependent uponthe number of objects, or elements, it may contain.

As used herein, a scoring container broadly refers to a containerimplemented to provide an approximation of a probability distributionover the values it contains, based upon samples from that probabilitydistribution. In certain embodiments, a scoring container may beimplemented as a percentile 910 container, a delta 912 container, or acombination thereof. As used herein, a percentile 910 container broadlyrefers to a container used to collect probability distributions offeatures extracted from certain interrelated events over a particularperiod of time 906, which are in turn used to perform scoringoperations, as described in greater detail herein. In certainembodiments, the extracted features may include an identifiercorresponding to the definition of the feature, an extracted valueassociated with the feature, a score derived from an extracted valueassociated with the feature, or a combination thereof. As likewise usedherein, a delta 912 container broadly refers to a container used tocollect probability distributions of features associated with certaininterrelated events over a particular period of time 906, which are inturn used to update a persistent datastore of event data, described ingreater detail herein. In certain embodiments, the objects collected andstored in a scoring container may include features associated with anevent, as described in greater detail herein.

In certain embodiments, scoring container update operations may includethe creation of an empty scoring container, the insertion of values,described in greater detail herein, into the scoring container, anddeletion of values from the scoring container. In various embodiments,scoring container update operations may likewise include the deletion ofall values in a scoring container, accessing certain values in thescoring container, and accessing the number of values in the scoringcontainer. Likewise, scoring container update operations in certainembodiments may include operations associated with providing anapproximation of a probability distribution of the values it contains.

In certain embodiments, the scoring container update operations may beimplemented to perform construction and maintenance of probabilitydistributions corresponding to certain features associated with anobserved event 924, or class of observed events 924, occurring during aparticular interval of time 906. In certain embodiments, theconstruction and maintenance of probability distributions may beperformed in real-time, batch mode, or on-demand. In certainembodiments, the resulting probability distributions may be processed bya probability distribution analysis system, described in greater detailherein, to determine the statistical likelihood of those observed events924 occurring, wherein the likelihoods are driven by empirical data. Incertain embodiments, one or more streaming scoring operations may beimplemented to determine the probability distributions as theobservations of events 924 are made in real-time, in batch mode, oron-demand.

In certain embodiments, multiple instances of a streaming scoringoperation may be run for a node cluster to analyze the same eventdataset, thereby providing horizontal scalability. As used herein, anode cluster, or cluster of nodes, broadly refers to a set of nodesorganized such that each event 924 observed by a probabilitydistribution analysis system, described in greater detail herein, isassociated with, and processed by, an individual, corresponding node. Incertain embodiments, horizontal scalability may be achieved by mergingmultiple probability distributions, as described in greater detailherein, into a single probability distribution.

In these embodiments, each node in a cluster maintains its ownprobability distribution and periodically accesses a persistentdatastore of scoring data 908 to provide its new observations of events924 to a global probability distribution, or pull changes from a globalprobability distribution of scoring data that has been added by othernodes 914, 974. As used herein, a persistent datastore of scoring data908 broadly refers to a repository of information implemented to becollaboratively referenced by a cluster of nodes in the performance oftheir associated scoring container update operations. In variousembodiments, scoring data from other nodes 914, 974, or associated withobserved events 924, may be added to the persistent datastore of scoringdata 908 at certain points in time P₁ 916, P₂ 918, P₃ 968, and so forthduring a particular period of time 906. Consequently, all nodes within acluster will have eventually-consistent observed data probabilitydistributions. Accordingly, certain embodiments of the invention reflectan appreciation that the persistent datastore of scoring data 908 canserve as a “consistent, global source of truth” when analyzing theprobability distribution of interrelated event features in real-time,batch mode, or on-demand.

In certain embodiments, the persistent datastore of event data may beimplemented as a relational database management system (RDBMS), astructured query language (SQL) RDBMS, a not only SQL (NoSQL) database,a graph database, or other database approaches familiar to those ofskill in the art. In certain embodiments, the persistent datastore ofevent data may be implemented to maintain distributed concurrencycontrol. As used herein, concurrency control broadly refers to variousapproaches known to skilled practitioners of the art to ensure correctresults for concurrent operations are generated. Certain embodiments ofthe invention reflect an appreciation that when certain system processesare operating concurrently, they may interact by messaging or sharingaccessed data, whether in memory or in storage. Consequently, theconsistency of one process may be violated, or compromised, by theoperation of another.

As likewise used herein, distributed concurrency control broadly refersto the concurrency control of a system, such as the probabilitydistribution analysis system described in greater detail herein,distributed over a computer network. In certain embodiments, distributedconcurrency control may be implemented as row versioning, which skilledpractitioners of the art will likewise recognize as a known form ofoptimistic concurrency control. Likewise, as used herein, optimisticconcurrency control (OCC) broadly refers to a various concurrencycontrol approaches applied to transactional systems, such as an RDBMS orsoftware transactional memories. Certain embodiments of the inventionreflect an appreciation that OCC optimistically assumes multipletransactions can frequently complete, with some degree of certainty,without interfering with one another.

In certain embodiments, the probability distribution associated with aparticular scoring container may be implemented as a continuousprobability distribution, a Boolean probability distribution, a one-hotprobability distribution, or combination thereof. As used herein, acontinuous probability distribution broadly refers to a probabilitydistribution that has a probability distribution function that iscontinuous. In certain embodiments, the continuous probabilitydistribution may be generated by an associated probability densityfunction. As likewise used herein, a probability density function (PDF),or density of a continuous random variable, broadly refers to afunction, the integral of which over any particular range within thesample space is equal to the relative likelihood that the value of therandom value would fall within that range. In certain embodiments, acontinuous probability distribution may be represented by a cumulativedistribution function, which for an particular sample value indicatesthe unlikelihood of a value being extreme, or more extreme than thatvalue.

Likewise, as used herein, a continuous random variable broadly refers toa variable that can take any real values, in a range which may or maynot be bounded. As a result, the variable is continuous within thatinterval. Accordingly, a continuous random variable may have acontinuous range of values, individual values being stored using afixed-point, floating-point, or fractional representation. As anexample, the cost of a transaction in some particular currency may beany value greater than or equal to zero and with no conceptual upperbound, which may be fractional with respect to the designated currency.

In certain embodiments, the continuous probability distribution may beimplemented as a numeric value probability distribution. As used herein,a numeric value probability distribution broadly refers to a continuousprobability distribution where the value of a variable is referenced asa numerical value. As an example, a military pilot's height may berequired to be between 64 and 77 inches tall when standing, 34 to 40inches tall when sitting, and weigh between 160 and 231 pounds,depending upon their height. In this example, the two real valuesrespectively establishing each physical measurement interval are 64 to77 inches standing, 34 to 40 inches tall sitting, and weighing 160 to231 pounds. Accordingly, a pilot that is 69 inches tall standing, 37inches sitting, and weighs 170 pounds would be described by numericvalues that are respectively continuous within each physical measurementinterval.

In certain embodiments, various t-Digest approaches may be used toimplement the continuous probability distribution for a scoringcontainer. Those of skill in the art will be familiar with t-Digest,which is a probabilistic data structure for estimating percentiles foreither distributed data or a stream of data. In general, the t-Digestdata structure is a sparse representation of a cumulative distributionfunction (CDF). In typical implementations, t-Digest data structureingests data, from which it learns “interesting” points, calledcentroids, within the ingested data. In certain embodiments, thecentroids may indicate where the CDF is changing most quickly within astream of ingested data. In certain embodiments, the centroids mayindicate where the percentiles, may be changing most quickly. In certainembodiments, the centroids may indicate where mass is concentratedwithin the PDF.

Certain embodiments of the invention reflect an appreciation that suchcentroids may provide an indication of a potential security threat. Asan example, a user may be attempting to download a series of largecustomer data files. In this example, typical user behavior may indicatethat the user rarely, if ever, downloads such files. Instead, they maysimply interact with various systems on an ad-hoc or intermittent basis,submitting queries and receiving responses. Consequently, the centroidsrepresenting the size of the large customer files the user may beattempting to download, from a percentile perspective, may indicateabnormal behavior, which may in turn represent malicious intent.

As likewise used herein, a Boolean probability distribution broadlyrefers to a probability distribution that takes on one of two values:true or false. Skilled practitioners of the art will be aware that sincea Boolean probability distribution takes on only one of two values, itis a discrete probability distribution instead of continual.Consequently, it does not have a corresponding probability densityfunction. Instead, it has a probability mass function. As an example, atrue condition may be represented as ‘1’ and a false condition may berepresented as ‘0’. Accordingly, if 57 out of 100 samples havecorresponding true condition, then the resulting probability massfunction would have a value of ‘0.57’.

Likewise, as used herein, a one-hot probability distribution broadlyrefers to a probability distribution of a group of bits, among which thelegal combinations of values are only those with a single high (“1”) bitand all the others are low (“0”). To continue a previous example, aparticular vehicle may be available in seven different colors, rangingfrom white to black. Other colors may include yellow, blue, green, redand grey. In this example, a random sample of twenty vehicles may beselected, where none of the selected vehicles was yellow. Accordingly, aone-hot probability distribution would result in the colors white,black, blue, green, red and grey having a single high (“1”) bit valueand the yellow vehicle having a low (“0”) bit value.

Referring now to FIG. 9 , the beginning of time window ‘1’ 902 within aperiod of time 906 is defined by point in time P1 916 and its end isdefined by point in time P2 918. Likewise, the beginning of time window‘2’ 904 is defined by point in time P3 968. In certain embodiments, thepercentile 910 container may be implemented to be initialized at pointin time P₁ 916 by receiving its initial contents from the persistentdatastore of scoring data 908. In certain embodiments, the initialvalues of the percentile 910 container are set at point in time P₁ 916by performing a percentile container initialization 920 operation, asfollows:{circumflex over (P)} ¹ =P ₁In certain embodiments, a delta 912 initialization operation 922 maylikewise be performed in certain embodiments to set the initial valuesof the delta 912 container to 0 at point in time P₁ 916.

Scoring container update operations are then initiated by the observanceof event ‘1’ 930, whose associated features are counted and representedby their corresponding values 936. These values are then respectivelyadded 932, 938 to both the percentile 910 and delta 912 containers. Thecontents of the percentile 910 container are then used to performscoring operations 960, as follows:

${\hat{P}}_{2} = {{\hat{P}}_{1} + {\sum\limits_{i = 1}^{n}{VAL}_{i}}}$which result in the generation of a score 934, which in turn isassociated with event ‘1’ 930. In certain embodiments, the score 934 maybe implemented to represent the unlikelihood of the occurrence of aparticular feature associated with event ‘1’ 930. In certainembodiments, the score may be used by a probability distributionanalysis system to generate a risk score. In certain embodiments, therisk score may be implemented to reflect possible anomalous, abnormal,unexpected or malicious behavior by an entity, as described in greaterdetail herein.

As events ‘2’ 940 through ‘n’ 950 are observed during time window ‘1’902, the values 946 through 956 of their corresponding features are theniteratively added 942 through 948, and 952 through 958, to thepercentile 910 and delta 912 containers. Likewise, the contents of thepercentile 910 container are iteratively used to perform scoringoperations 960, which result in scores 944 through 954 being iterativelyassociated with events ‘2’ 940 through ‘n’ 950. As previously described,the resulting scores 944 through 954 may be implemented in certainembodiments to represent the unlikelihood of the occurrence of aparticular feature associated with events ‘2’ 940 through ‘n’ 950.

At point in time P₂ 918, which defines the end of time window ‘1’ 902,scoring operations 960 are once again performed on the contents of thepercentile 910 container to produce a probability distribution offeatures associated with the observed events 924. In certainembodiments, the scoring operations 960 may be implemented to generate acomposite score associated with events ‘1’ 930 through ‘n’ 950. Incertain embodiments, scores 934 through 954 may be implemented torepresent the unlikelihood of the occurrence of a particular feature, ora group of features, associated with events ‘1’ 930 through ‘n’ 950.

In certain embodiments, the composite score may be used by a probabilitydistribution analysis system in certain embodiments to generate acomposite risk score associated with events ‘1’ 930 through ‘n’ 950. Incertain embodiments, the composite risk score may be implemented toreflect possible anomalous, abnormal, unexpected or malicious behaviorby an entity, or entities, during time window ‘1’ 902, as described ingreater detail herein. As an example, events ‘1’ 930 through ‘n’ 950 maybe associated with the user behavior of a particular entity during timewindow ‘1’ 902. Likewise, an individual event of events ‘1’ 930 through‘n’ 950 may be associated with the user behavior of multiple entitiesduring time window ‘1’ 902. Accordingly, the composite score in certainembodiments may be implemented to represent a composite risk scoreassociated with the entity during time window ‘1’ 902.

Likewise, delta container summation 962 operations are iterativelyperformed on the contents of the delta 912 container during time window‘1’ 902, as follows, to show changes in the probability distribution offeatures as each observed event 924 occurs:

$\Delta = {\sum\limits_{i = 1}^{n}{VAL}_{i}}$During time window ‘1’ 902, scoring data from other nodes 914 isiteratively received by, and added to, the persistent datastore ofscoring data 908. The contents of the persistent datastore of scoringdata 908 at point in time P₂ 918 are then added to the sum 970 of thescoring operations shown in block 960 and the results of the deltaoperations shown in block 962 at the end of time window ‘1’ 902, asfollows:P ₃ ={circumflex over (P)} ₂+Δ

The resulting values are then used to perform scoring data update 970operations to update the contents of the persistent datastore of scoringdata 908 at point in time P₃ 968. In turn, the updated values stored inthe persistent datastore of scoring data 908 at point in time P₃ 968 areused to perform percentile container initialization 980 operations toinitialize the percentile 910 container for time window ‘2’ 904, asfollows:{circumflex over (P)} ₃ =P ₃Likewise, delta container initialization 982 operations are performed toset the initial values of the delta 912 container to 0 at point in timeP₃ 968 in time window ‘2’ 904, same as for point in time P₁ 916 in timewindow ‘1’ 902. The operations performed for time window ‘1’ 902 arethen repeated for time window ‘2’ 904.

FIG. 10 shows the probability density function (PDF) distribution ofcertain features over a series of time windows implemented in accordancewith an embodiment of the invention. In certain embodiments, an eventstream 1002 containing interrelated event features may be captured overa particular period of time 1014. In certain embodiments, the eventstream 1002 may be processed, as described in greater detail herein, togenerate extracted features, which in turn are processed to determinetheir associated probability distributions. In certain embodiments, theevent stream 1002 may be processed by a probability distributionanalysis system in real-time, batch mode, or on-demand.

In certain embodiments, the extracted features may be processed todetermine their associated probability distributions for a sequence oftime windows, such as time windows ‘1’ 1004, ‘2 1006, ‘3’ 1008, ‘4’1010, and ‘5’ 1012 within a particular period of time 1014. In certainembodiments, the sequence of time windows ‘1’ 1004 through ‘5’ 1012 maybe contiguous to one another. As an example, time windows ‘1’ 1004, ‘2’1006, ‘3’ 1008, ‘4’ 1010, and ‘5’ 1012 may respectively correspond tohours 1:00 PM through 6:00 PM of the same day. In certain embodiments,the sequence of time windows ‘1’ 1004, ‘2 1006, ‘3’ 1008, ‘4’ 1010, and‘5’ 1012 may not be contiguous to one another. For example, time windows‘1’ 1004, ‘2 1006, ‘3’ 1008, ‘4’ 1010, and ‘5’ 1012 may respectivelycorrespond to a 24 hour period of time occurring on Wednesdays ofsequential weeks.

In certain embodiments, a series of actual 1022 PDF distributions 1024,1026. 1028, 1030, and 1032, respectively corresponding to the occurrenceof certain features associated with a set of interrelated events, arecollected for time windows ‘1’ 1004, ‘2 1006, ‘3’ 1008, ‘4’ 1010, and‘5’ 1012 occurring within a particular period of time 1014. As anexample, the interrelation of the events may be a result of each of theevents being associated with the user behavior of a particular userduring the time windows ‘1’ 1004, through ‘5’ 1012. However, as shown inFIG. 10 , a naïve 1042 PDF distribution 1044, 1046, 1048, 1050, and 1052of these interrelated event features over time windows ‘1’ 1004 through‘5’ 1012 would likely result in a blurring of non-stationary modes ofthe distribution. As used herein, a naïve 1042 distribution broadlyrefers to a distribution in which a single scoring container, describedin greater detail herein, is used to iteratively accrue samples acrossall involved time windows, such as the time windows ‘1’ 1004 through ‘5’1012.

Various embodiments of the invention reflect an appreciation thatcertain interrelated event features may correspond to indicators of apotential security threat. Certain embodiments of the invention likewisereflect an appreciation that a blurring of non-stationary modes of thePDF distribution of interrelated event features over a given period oftime 1002 may make it challenging to identify which features areassociated with which threats. Accordingly, PDF distributions ofinterrelated event features are respectively generated in variousembodiments for certain time windows, such as time windows ‘1’ 1004through ‘5’ 1012.

However, various embodiments of the invention likewise reflect anappreciation that individual PDF distributions of interrelated eventfeatures within time windows ‘1’ 1004 through ‘5’ 1012 may likewise failto indicate certain trends. As an example, certain features may begin tooccur more frequently over various time windows ‘1’ 1004 through ‘5’1012. Accordingly, the PDF distributions of interrelated event featurescorresponding to two or more sequential time windows may be combined incertain embodiments to provide a combined PDF probability distribution.In certain embodiments, two or more combined PDF probabilitydistributions may be implemented to provide a staggered window PDFprobability distribution. As used herein, a staggered window PDFprobability distribution broadly refers to a combined PDF distributionthat shares one or more sequential time windows associated with a secondcombined PDF probability distribution.

As an example, as shown in FIG. 10 , the PDF distribution 1024 ofinterrelated event features associated with time window ‘1’ 1004 iscontained in scoring container ‘1’ 1064. However, the PDF distribution1024 contained in scoring container ‘1’ 1060 provides insufficient datafor trend analysis of certain features occurring within staggered windowSW ‘1’ 1066 as it has no preceding time window. Instead, it is simplybased upon the “naïve” PDF distribution 1044 for time window ‘1’ 1004.However, the PDF distribution stored in scoring container ‘1’ 1060 canbe used as a reference for trend analysis of certain features occurringwithin time window ‘2’ 1006.

To continue the example, the combined PDF distribution for staggeredwindow SW ‘2’ 1066 is based upon the sum of PDF distributions 1024,1026, respectively stored in scoring containers ‘1’ 1062 and ‘2’ 1064,which in turn respectively correspond to time windows ‘1’ 1004 and ‘2’1006. Consequently, the combined PDF distribution for staggered windowSW ‘2’ 1070 provides sufficient data for trend analysis of certainfeatures occurring within staggered window SW ‘3’ 1070. Accordingly, thecombined PDF distribution for staggered window SW ‘3’ 1070 is based uponprocessing the PDF distributions 1026, 1028, respectively stored inscoring containers ‘2’ 1064 and ‘3’ 1068, which in turn respectivelycorrespond to time windows ‘2’ 1006 and ‘3’ 1008.

As before, the combined PDF distribution for staggered window SW ‘3’1070 provides sufficient data for trend analysis of certain featuresoccurring within staggered window SW ‘4’ 1074. Accordingly, the combinedPDF distribution for staggered window SW ‘4’ 1074 is based uponprocessing the PDF distributions 1028, 1030 respectively stored inscoring containers ‘3’ 1068 and ‘4’ 1072, which in turn respectivelycorrespond to time windows ‘3’ 1008 and ‘4’ 1010. The process incontinued to generate a combined PDF distribution for staggered windowSW ‘5’ 1076 by processing the PDF distributions 1030, 1032, respectivelystored in scoring containers ‘4’ 1072 and ‘5’ (not shown), which in turnrespectively correspond to time windows ‘4’ 1010 and ‘5’ 1012.

In certain embodiments, the probability distributions corresponding totime windows ‘1’ 1004 through ‘5’ 1012 may be implemented as cumulativedistribution function (CDF) distributions (not shown). In certainembodiments, the CDF distributions may be generated through the use oft-Digest, described in greater detail herein. Certain embodiments of theinvention reflect an appreciation the t-Digest is efficient in its useof memory and storage, supports merging, and provides high resolutiontoward the extremes of the probability distribution. The spaceefficiency and ability to update t-digests quickly, allowing themaintenance of multiple probability distributions across overlapping,staggered time windows. As an example, the probability of an emailcontaining an attachment with greater than “x” bytes can be tracked overa one-week window, staggering those one-week windows every hour. Fromthe foregoing, those of skill in the art will recognize that inferredcumulative probability distributions will change over time as theunderlying probability distributions change.

FIG. 11 is a generalized process flow diagram of the performance of datasearch and feature matching operations associated with the compilationof a query implemented in accordance with an embodiment of theinvention. In certain embodiments, a query language parser 1104,familiar to those of skill in the art, may be used to perform featurematching operations associated with a query. For example, as shown inFIG. 11 , a query language parser 1104 may be used to identify 1102 aquery language-based feature (e.g., “subject:foobar”) in various dataassociated with an event. In certain embodiments, a Domain-SpecificLanguage (DSL), likewise described in greater detail herein, may be usedto perform feature matching operations associated with a query. Forexample, as likewise shown in FIG. 11 , a Java-embedded DSL 1108 may beused to identify 1106 a Java-based feature (e.g., subject.phrase“foobar”) in various data associated with an event. In certainembodiments, the resulting feature may be used to generate a compiledquery 1110. In certain embodiments, the compiled query 1110 may beimplemented as a DSL Query (e.g., DSLQuery<RevealInternalEvent>).

In certain embodiments, query reduction 1112 operations may be performedon the resulting compiled query 1110. In certain embodiments, the queryreduction operations 1112 may be implemented to reduce the compiledquery to a class 1114 of queries (e.g., ReducedQuery(ESQuery.class). Incertain embodiments, the resulting class 1116 of queries, (e.g.,esQuery.query( )), may be used in the performance of search querygeneration 1118. In certain embodiments, the resulting class 1116 ofqueries may be implemented to query a persistent datastore of eventdata. In certain embodiments, the results of the search query generation1118 may be used to perform batch scoring 1120 operations, streamingbootstrapping 122 operations, of a combination thereof.

In certain embodiments, the resulting class of queries 1124 (e.g.,esQuery.matcher( )) may be used in the performance of various matchingoperations, described in greater details herein. In certain embodiments,the resulting class of queries 1124 may be implemented to perform thequery in-memory or in-process. In certain embodiments, the matchingoperations (e.g., Matcher<RevealInternalEvent>) may be performed by adiscrete event matcher 1126. As used herein, a discrete feature broadlyrefers to an individual feature, described in greater detail herein,associated with an event, likewise described in greater detail herein.In certain embodiments, a discrete feature matcher may be implemented toprocess various data associated with an event to identify a matching,discrete feature in an associated compiled query 1110.

In certain embodiments, a multimatcher 1128 may be implemented to usethe results of the matching operations performed by the discrete eventmatcher 1126 to perform concurrent matching operations associated withmultiple discrete features. In certain embodiments, a DSL queryprocessing 1130 operations may be implemented to use the results of thematching operations performed by a discrete event matcher 1126,associated with the multimatcher 1128 to perform a DSL query, likewisedescribed in greater detail herein. In certain embodiments, themultimatcher 1128 may be associated with two or more event matchers1126, each of which may be respectively implemented to performindividual event matching operations. In certain embodiments, a DSLquery processing 702 module, described in the descriptive textassociated with FIG. 7 , may be implemented to perform the DSL queryprocessing operations.

Certain embodiments of the invention reflect an appreciation a predicateof a query may refer to all manner of things, such as which entities maybe associated with a particular event, what their respective roles maybe, values or ranges for metadata, and so forth. Other examples of suchquery predicates include the content of the subject field and body of anemail, as well as text extracted from an associated attachment. Certainembodiments of the invention likewise reflect an appreciation thatqueries of such predicates may involve interpreting their respectivestring values in various ways according to the syntax of theirassociated DSL.

In certain embodiments, such an interpretation may include an exactmatch of a specified whole value. In certain embodiments, such aninterpretation may include a match on a sub-phrase, subject to lexicalanalysis. For example, the sub-phrase “hello world” matching a portionof the string “I say hello, world, to everyone.” In certain embodiments,such an interpretation may include a match on a sub-phrase that is notzoned. As an example, the target string may include a disclaimerattached to, or text quoted within, an email thread. In certainembodiments, such an interpretation may include a proximity search, suchas searching for terms in a lexically-analyzed input stream that areproximate to one another with possible intervening terms. In certainembodiments, such an interpretation may include the use of wildcardmatches (e.g., ‘*’ or ‘?’), or fuzzy matches, such as terms matchingwithin a certain Levenshtein distance.

Certain embodiments of the invention reflect an appreciation that theimplementation of lexical analysis may require significant resources. Asan example, a target body of text containing 10,000 tokens may beprocessed with 1,000 associated queries to identify their matchingfeatures. Typical approaches to the performance of such queries with alexical analyzer may require repeating associated analysis processes foreach query. Consequently, a total of 10 million tokens may be processed(i.e., 1,000 queries times 10,000 target tokens). Alternatively, onepass through the 10,000 tokens may be performed, which results in thereification of each token, which may involve many heap allocations. Inturn, the resulting tokens may then be iterated repetitiously to performthe queries.

In certain embodiments, a matching algorithm may be implemented toprocess a target body of text in a single pass to identify matchingfeatures contained within a plurality of associated queries. In certainof these embodiments, allocations from the heap are only performed totrack actual matches as opposed every token the algorithm examines.Likewise, in certain embodiments, a given kind of lexical analysis isperformed on any field once, and then only if doing so is actuallyrequired to determine whether the document contains a matching term. Asan example, “mode:chat” and “body: {Oversight Words}” would search forany terms from a lexicon called “Oversight Words” in the body of chatmessages, but would not lexically analyze the body of any email to lookfor oversight words as that operation has already been eliminated by thecheaper term mode:chat. Accordingly, for a given target number ofqueries to match (e.g., hundreds to thousands) an order of magnitude ormore speed may be realized using the same hardware than either indexingthe document in an in-memory database and then querying against it ormatching each query independently.

FIG. 12 is a generalized process flow diagram of the performance of lazymatching operations for a single, analyzed query implemented inaccordance with an embodiment of the invention. As used herein, lazymatching, also commonly referred to as lazy evaluation or call-by-need,broadly refers to an evaluation approach that delays the evaluation ofan expression until its value is needed, and which also avoids repeatedevaluation (i.e., sharing). In various embodiments, a call (e.g.,test(event)) 1208 may be made to test whether certain featuresassociated with a particular event match a given query (e.g., “helloworld”).

In these embodiments, a Matcher 1210 for that predicate may not knowwhether it is a match or not. However, it does know that it isassociated with a phrase match sink 1206 (e.g., PhraseMatchSink), whichmay be looking for the phrase “hello world.” Accordingly, it asks thesink 1206 whether it matches. In turn, the sink 1206 may not knoweither. However, it does know it receives its input (e.g.,Analysis.STANDARD) from an analyzing feature extractor 1204 (e.g.,AnalyzingExtractor), which in turn knows it has not yet been run.Accordingly, it runs by taking the string from the input field 1202(e.g., event.subject( )) and performs a lexical analysis. As a result,the original field 1202 is passed through as a result of the lexicalanalysis performed by the analyzing feature extractor 1204.

FIG. 13 is a generalized process flow diagram of the performance of lazymatching operations for a mixed analyzed and non-analyzed queryperformed in accordance with an embodiment of the invention. In variousembodiments, a call (e.g., test(event)) 1318 may be made to test whethercertain features associated with a particular event match a given query(e.g., subject:“hello”, subject=“world”) In certain embodiments, such aquery may ask whether any features associated with an event contain theword “hello” after lexical analysis OR exactly match the string “world.”

Referring now to FIG. 13 , a MultiMatcher 1316 may be implemented incertain embodiments to receive a call 1318 (e.g., test(event)) to testwhether an event matches. In certain embodiments, the MultiMatcher 1316may be implemented to perform multi match operations, which as usedherein, broadly refers to coordinating the use of two or more matchers,such as a PhraseMatcher 1308 or an ExactMatcher 1314, to perform two ormore matching operations associated with a single query. For example, aMultiMatcher 1316 for a particular predicate may not know whether it isa match or not. Yet it may know it is the “OR” of one of two othermatchers, PhraseMatcher 1308, which is associated with a phrase matchsink 1306 (e.g., PhraseMatchSink), which in turn may be looking for thephrase “hello,” and ExactMatcher 1314, which is likewise associated withan exact match sink 1312 (e.g., ExactMatchSink), that in turn may belooking for the exact phrase “world.”

In certain embodiments, the MultiMatcher 1316 may start with theExactMatcher 1314, as it is associated with an exact feature extractor1308 (e.g., ExactExtractor( )), which has lower processing cost metric.Accordingly, the ExactMatcher 1314 asks the exact match sink 1312, whichin turn asks its associated exact feature extractor 1318 for the value“world.” As a result, the original field 1302 (e.g., event.subject( ))is passed through without any lexical analysis.

If there is a match, then the MultiMatcher 1316 knows its “OR” has beensatisfied. Otherwise, the MultiMatcher 1316 asks the PhraseMatcher 1308,which in turn asks the phrase match sink 1306. In turn, the phrase matchsink 1306 asks its associated analyzing feature extractor 1304 (e.g.,AnalyzingExtractor (Analysis.STANDARD)) for the value “hello.” As aresult, the original field 1302 (e.g., event.subject( )) is passedthrough as a result of the lexical analysis performed by the analyzingfeature extractor 1304.

FIG. 14 is a generalized process flow diagram of the performance of lazymatching operations based upon a shared extractor implemented inaccordance with an embodiment of the invention. In various embodiments,a call 1416 (e.g., test(event)) may be made to test whether certainfeatures associated with a particular event match a given query basedupon an analyzed version of the field. In certain embodiments, the termsdefining a feature may not be contiguous to one another. Instead, theymay have one or more intervening “slop” terms separating them (e.g.,subject:(“hello” “world”˜1). As an example, the features may contain thephrase “hello beautiful world.” In certain embodiments, the termsdefining a feature may be contiguous (e.g., subject:“hello world”).Accordingly, the contiguous features may not have the identical sequenceof terms in a given query.

Referring now to FIG. 14 , a call 1416 (e.g., test(event)) may be madeto test whether the event matches. However, the MultiMatcher 1414 forthat predicate may not know whether it is a match or not. Yet it mayknow it is the “OR” of one of two other matchers, ProximityMatcher 1408,which is associated with a proximity sink 1406 (e.g., ProximitySink),which in turn may be looking for phrases that include the features“hello” and “world” that are proximate to one another, and PhraseMatcher1412, which is likewise associated with a phrase match sink 1410 (e.g.,PhraseMatchSink) that in turn may be looking for the identical sequenceof terms in the phrase “hello world.”

Accordingly, the MultiMatcher 1412 may first elect to useProximityMatcher 1408. Certain embodiments of the invention reflect anappreciation that either the ProximityMatcher 1408 or the PhraseMatcher1412 may be chosen first, as they are both associated with an analyzingextractor 1404 (e.g., AnalyzingExtractor (Analysis.STANDARD)).Consequently, there an insubstantial difference in their respectiveprocessing costs.

Once the MultiMatcher 1412 selects the ProximityMatcher 1408, it in turnasks a proximity sink 1406 (e.g., ProximitySink), which in turn asks theanalyzing extractor 1404 for the value (“hello” “world”˜1). As a result,the analyzing extractor 1404 lexically analyzes the value of the fieldin the event 1402, followed by the analyzing extractor 1404 pushing itstoken stream to both the proximity sink 1406 and the phrase match sink1408. If the proximity match sink 1406 is not a match, then thePhraseMatcher 1412 asks the phrase match sink 1408 whether it matched.

However, this operation does not result in the invocation ofAnalyzingExtractor 1404 as it has already run, and its dependentproximity sink 1406 and phrase match sink 1408 have memorized theresults. As used herein, memorizing broadly refers to known optimizationapproaches commonly used to increase the processing speed of computerprograms by storing the results of expensive function calls in a cacheand returning the cached result when the same inputs occur again.Thereafter, the ProximityMatcher 1408 provides a final result by passingthe original field 1402 (e.g., event.subject( )) through as a result ofthe lexical analysis performed by the analyzing extractor 1404.

FIG. 15 is a generalized process flow diagram of the performance of lazymatching operations performed with different lexical analyzersimplemented in accordance with an embodiment of the invention. Invarious embodiments, a call 1520 (e.g., test(event)) may be made to testwhether certain features associated with a particular event match agiven query based upon an analyzed version of the field. In certainembodiments, the features contained may not share the sameclassification. As an example, features associated with an email eventmay have various classifications, such as “subject line,” “body,”“attachment,” and so forth. To continue the example, a query may containthe features “hello world,” which may reside in an email's subject line(e.g., subject:“hello world”) “OR” its body (body:“hello world”).

Referring now to FIG. 15 , a call 1520 (e.g., test(event)) may be madeto test whether the event matches. However, the MultiMatcher 1518 forthat predicate may not know whether it is a match or not. Yet it mayknow it is the “OR” of one of two other matchers, PhraseMatcher1 1408,which is associated with a phrase match sink ‘1’ 1506 (e.g.,PhraseMatchSink1), which in turn may be looking for phrases that includethe features “hello world” in the subject line of an email, andPhraseMatcher2 1516, which is likewise associated with a phrase matchsink ‘2’ 1514 (e.g., PhraseMatchSink2) that in turn may be looking forthe phrase “hello world” in the body of an email.

Accordingly, the MultiMatcher 1516 may first elect to use PhraseMatcher11408. Certain embodiments of the invention reflect an appreciation thatthe PhraseMatcher1 1508, associated with an analyzing extractor ‘1’ 1504(e.g., AnalyzingExtractor1 (Analysis.STANDARD)), may be chosen first, asthe subject line of an email is typically shorter than its body.Consequently, its processing costs may be less than selectingPhraseMatcher2 1516, which is associated with analyzing extractor ‘2’1504 (e.g., AnalyzingExtractor2 (Analysis.EXCLUDE_ZONED_TEXT)).

Once the MultiMatcher 1518 selects the PhraseMatcher1 1508, it in turnasks the phrase match sink ‘1’ 1506 (e.g., PhraseMatchSink1), which inturn asks the analyzing extractor ‘1’ 1504 for the value (“helloworld”). If a match is found in the subject line of the email, then thePhraseMatcher1 1508 provides a final result by passing the originalfield 1502 (e.g., event.subject( )) through as a result of the lexicalanalysis performed by the analyzing extractor ‘1’ 1504. However, if nomatch is found, then phrase match sink ‘2’ 1514 is invoked by thePhraseMatcher2 1514, which causes the analyzing extractor ‘2’ 1512 toperform lexical analysis on the larger field of the email body 1510,excluding zoned text such as disclaimers, boilerplate, repetitive text,and so forth. If a match is found in the body of the email, then thePhraseMatcher2 1516 provides a final result by passing the originalfield 1510 (e.g., event.body( )) through as a result of the lexicalanalysis performed by the analyzing extractor ‘2’ 1512.

FIG. 16 is a generalized process flow diagram of the performance of lazymatching operations with reuse across queries implemented in accordancewith an embodiment of the invention. In various embodiments, a call 1626(e.g., test(event)) may be made to test whether certain featuresassociated with a particular event match a given query based upon ananalyzed version of the field. In certain embodiments, the featurescontained may not share the same classification. As an example, featuresassociated with an email event may have various classifications, such as“subject line,” “body,” “attachment,” and so forth. To continue theexample, a query may contain the features “hello world” “OR” “foo,”either of which may reside in an email's subject line (e.g.,subject:“hello world”, subject:“foo”), “OR” the feature “hello world”may reside in its body (e.g., body:“hello world”).

Referring now to FIG. 16 , a call 1626 (e.g., test(event)) may be madeto test whether the event matches. However, the Matcher 1624 for thatpredicate may not know whether it is a match or not. Yet it may know itis the “OR” of one of three other matchers, PhraseMatcher1 1608,PhraseMatcher2 1702, and PhraseMatcher3 1622. As shown in FIG. 16 ,PhraseMatcher1 1608 is associated with phrase match sink ‘1’ 1506 (e.g.,PhraseMatchSink1), which in turn may be looking for phrases that includethe features “hello world” in the subject line of an email. Likewise,PhraseMatcher2 1702, which is associated with phrase match sink ‘2’ 1610(e.g., PhraseMatchSink2), in turn may be looking for the phrase “foo” inthe subject line of an email as well. As likewise shown in FIG. 16 ,PhraseMatcher3 16226, which is associated with phrase match sink ‘3’1514 (e.g., PhraseMatchSink3), in turn may be looking for the phrase“hello world” in the body of an email.

Accordingly, the Matcher 1624 may first elect to use PhraseMatcher1 1608or PhraseMatcher2, both of which are associated with an analyzingextractor ‘1’ 1604 (e.g., AnalyzingExtractor1 (Analysis.STANDARD)), asthe subject line of an email is typically shorter than its body.Consequently, its processing costs may be less than selectingPhraseMatcher3 1516, which is associated with analyzing extractor ‘2’1618 (e.g., AnalyzingExtractor2 (Analysis.EXCLUDE_ZONED_TEXT)). Once theMatcher 1624 selects the PhraseMatcher1 1608, it in turn asks the phrasematch sink ‘1’ 1606 (e.g., PhraseMatchSink1), which in turn asks theanalyzing extractor ‘1’ 1604 for the value (“hello world”). If a matchis found in the subject line of the email, then the PhraseMatcher1 1608provides a final result by passing the original field 1602 (e.g.,event.subject( )) through as a result of the lexical analysis performedby the analyzing extractor ‘1’ 1604.

However, if no match is found, then the PhraseMatcher 1702 asks thephrase match sink 1610 for the value “foo.” If a match is found in thesubject line of the email, then the PhraseMatcher2 1702 provides a finalresult by passing the original field 1602 (e.g., event.subject( ))through as a result of the lexical analysis performed by the analyzingextractor ‘1’ 1604, as before. However, if no match is found, thenphrase match sink ‘3’ 1620 is invoked by the PhraseMatcher3 1622, whichcauses the analyzing extractor ‘2’ 1618 to perform lexical analysis onthe larger field of the email body 1616, excluding zoned text such asdisclaimers, boilerplate, repetitive text, and so forth. If a match isfound in the body of the email, then the PhraseMatcher3 1622 provides afinal result by passing the original field 1616 (e.g., event.body( ))through as a result of the lexical analysis performed by the analyzingextractor ‘2’ 1618.

In certain embodiments, two matchers, such as PhraseMatcher1 1608 andPhraseMatcher2 1702, that are associated with the same extractor (e.g.,AnalyzingExtractor1 (Analysis.STANDARD)) may be implemented such thatthey result in a combined query 1614. In certain embodiments, suchmultiple, or combined, queries may be compiled together such that theycan share intermediate results. Consequently, when a second matcher(e.g., PhraseMatcher2 1702) is tested, a corresponding sink (e.g.,phrase match sink ‘2’ 1610) can provide it with a result withoutadditional processing. In certain embodiments, a Matcher 1624 may beimplemented to sequentially call a test(event) 1626 for each of itsassociated matchers (e.g., PhraseMatcher1 1608, PhraseMatcher2 1702, andPhraseMatcher3 1622) and return all results as a table of Boolean valueskeyed by a unique ID corresponding to the query each matcher wascompiled from.

FIGS. 17 a and 17 b are a generalized flowchart of the performance ofscoring container update operations implemented in accordance with anembodiment of the invention. In this embodiment, scoring containerupdate operations are begun in step 1702, followed by a determinationbeing made in step 1704 whether to perform matching operations onfeatures, as described in greater detail herein. If so, the queries areregistered in step 1706, as likewise described in greater detail herein,followed by the performance of matching operation on features withinregistered queries in step 1708. Thereafter, or if it was decided instep 1704 to not perform matching operations, the current value ‘P’ of apercentile scoring container is read, and the value of a correspondingdelta scoring container is set to zero, in step 1710.

A determination is then made in step 1712 whether a synchronization timewindow has elapsed. If not, then various data associated with event ‘e’is collected in step 1714, followed by setting the value of the datacorresponding to the observed event as VAL=FVE(e) in step 1716. Theresulting VAL associated with the data corresponding to the observedevent is then added to the current value stored in the percentile anddelta scoring containers. Thereafter, the score associated with theevent is calculated in step 1720 as SCORE(e)=P(VAL), followed byforwarding data associated with event ‘e’ to a persistent datastore instep 1722.

However, if it was determined in step 1712 that a synchronizing timewindow has elapsed, then the value ‘P for the percentile scoringcontainer is read in step 1724, followed by the addition in step 1726 ofthe values currently stored in the delta scoring container. Theresulting value ‘P’ of the percentile scoring container is then storedin step 1728, followed by setting the value of the delta scoringcontainer to zero in step 1730. Thereafter, or after event ‘e’ has beenforwarded in step 1722, a determination is made in step 1732 whether toend scoring container update operations. If not, the process iscontinued, proceeding with step 1712. Otherwise, scoring containerupdate operations are ended in step 1734.

FIG. 18 shows the operation of a probability distribution analysissystem displayed within a user interface implemented in accordance withan embodiment of the invention. In this embodiment, the a risk graph1804 displayed within a user interface (UI) window 1802 depicts thefluctuation of risk scores 1806 at different points in time within aparticular date range 1808. In certain embodiments, the fluctuation ofrisk scores 1806 displayed within the risk graph 1804 corresponds to thepotential risk associated with a particular user 1810 at various pointsin time within the date range 1808. In certain embodiments, a riskdetails window 1812 corresponding to the user 1810 may be displayedwithin the UI window 1802.

In certain embodiments, summary information may likewise be displayedwithin the UI window 1802. For example, as shown in FIG. 18 , the lastupdate 1820 of the risk graph 1804, the number of entities 1822monitored in the last 24 hours, and the number of events 1824 observedin the last 24 hours may be displayed. In certain embodiments,individual entities 1816 being monitored, and their associated riskscores 1818, may be displayed in ranked order 1814 by theircorresponding risk scores within the UI window 1802.

As will be appreciated by one skilled in the art, the present inventionmay be embodied as a method, system, or computer program product.Accordingly, embodiments of the invention may be implemented entirely inhardware, entirely in software (including firmware, resident software,micro-code, etc.) or in an embodiment combining software and hardware.These various embodiments may all generally be referred to herein as a“circuit,” “module,” or “system.” Furthermore, the present invention maytake the form of a computer program product on a computer-usable storagemedium having computer-usable program code embodied in the medium.

Any suitable computer usable or computer readable medium may beutilized. The computer-usable or computer-readable medium may be, forexample, but not limited to, an electronic, magnetic, optical,electromagnetic, infrared, or semiconductor system, apparatus, ordevice. More specific examples (a non-exhaustive list) of thecomputer-readable medium would include the following: a portablecomputer diskette, a hard disk, a random access memory (RAM), aread-only memory (ROM), an erasable programmable read-only memory (EPROMor Flash memory), a portable compact disc read-only memory (CD-ROM), anoptical storage device, or a magnetic storage device. In the context ofthis document, a computer-usable or computer-readable medium may be anymedium that can contain, store, communicate, or transport the programfor use by or in connection with the instruction execution system,apparatus, or device.

Computer program code for carrying out operations of the presentinvention may be written in an object oriented programming language suchas Java, Smalltalk, C++ or the like. However, the computer program codefor carrying out operations of the present invention may also be writtenin conventional procedural programming languages, such as the “C”programming language or similar programming languages. The program codemay execute entirely on the user's computer, partly on the user'scomputer, as a stand-alone software package, partly on the user'scomputer and partly on a remote computer or entirely on the remotecomputer or server. In the latter scenario, the remote computer may beconnected to the user's computer through a local area network (LAN) or awide area network (WAN), or the connection may be made to an externalcomputer (for example, through the Internet using an Internet ServiceProvider).

Embodiments of the invention are described with reference to flowchartillustrations and/or block diagrams of methods, apparatus (systems) andcomputer program products according to embodiments of the invention. Itwill be understood that each block of the flowchart illustrations and/orblock diagrams, and combinations of blocks in the flowchartillustrations and/or block diagrams, can be implemented by computerprogram instructions. These computer program instructions may beprovided to a processor of a general purpose computer, special purposecomputer, or other programmable data processing apparatus to produce amachine, such that the instructions, which execute via the processor ofthe computer or other programmable data processing apparatus, createmeans for implementing the functions/acts specified in the flowchartand/or block diagram block or blocks.

These computer program instructions may also be stored in acomputer-readable memory that can direct a computer or otherprogrammable data processing apparatus to function in a particularmanner, such that the instructions stored in the computer-readablememory produce an article of manufacture including instruction meanswhich implement the function/act specified in the flowchart and/or blockdiagram block or blocks.

The computer program instructions may also be loaded onto a computer orother programmable data processing apparatus to cause a series ofoperational steps to be performed on the computer or other programmableapparatus to produce a computer implemented process such that theinstructions which execute on the computer or other programmableapparatus provide steps for implementing the functions/acts specified inthe flowchart and/or block diagram block or blocks.

The present invention is well adapted to attain the advantages mentionedas well as others inherent therein. While the present invention has beendepicted, described, and is defined by reference to particularembodiments of the invention, such references do not imply a limitationon the invention, and no such limitation is to be inferred. Theinvention is capable of considerable modification, alteration, andequivalents in form and function, as will occur to those ordinarilyskilled in the pertinent arts. The depicted and described embodimentsare examples only, and are not exhaustive of the scope of the invention.

Consequently, the invention is intended to be limited only by the spiritand scope of the appended claims, giving full cognizance to equivalentsin all respects.

What is claimed is:
 1. A computer-implementable method for performing arisk assessment operation, comprising: receiving a stream of data via aprotected endpoint of a plurality of protected endpoints, the stream ofdata representing electronically-observable interactions by a user, theelectronically-observable interactions being observed through at leastone of an electronic device, a computer system and a softwareapplication executing on the computing system, the protected endpointidentifying a plurality of events from the interactions by the user, atleast some of the plurality of events corresponding to user actions, theprotected endpoint comprising an endpoint device and an endpoint agent,the endpoint agent executing on a hardware processor of the endpointdevice, the protected endpoint providing a policy-based approach tonetwork security; enriching data associated with each of the pluralityof events to provide enriched data associated with each of the pluralityof events; extracting features from the plurality of events using theenriched data associated with each of the plurality of events;generating enriched events corresponding to each of the plurality ofevents based upon enriched data associated with each of the plurality ofevents and the features extracted from the plurality of events;performing a probability distribution operation on the enriched events,the probability distribution operation analyzing probabilitydistributions of the features extracted from the plurality of events,the probability distribution operation comprising a scoring containerupdate operation, the scoring container update operation using a scoringcontainer to provide an approximation of a probability distribution ofthe features from the plurality of events for a particular time windowacross a sequence of time windows, the scoring container beingimplemented as a percentile container and a delta container, thepercentile container collecting probability distribution of featuresextracted from certain interrelated events of a particular period oftime which are then used to perform scoring operations, the deltacontainer collecting probability distribution of features extracted fromcertain interrelated events of a particular period of time which arethen used to update a persistent datastore; performing a scoringoperation using contents of the percentile container, the scoringoperation being performed as:${\hat{P}}_{2} = {{\hat{P}}_{1} + {\sum\limits_{i = 1}^{n}{VAL}_{i}}}$where P₁ corresponds to a first point in time; P₂ corresponds to asecond point in time; and, VAL_(i) corresponds to a score value of anassociated feature; generating a risk score for the user based upon theenriched events and the probability distribution; and, performing therisk assessment operation via a security analytics system based upon theenriched events, the security analytics system executing on a hardwareprocessor, the risk assessment operation taking into account the riskscore, the plurality of protected endpoints communicating with thesecurity analytics system via a network, the security analytics systembeing implemented in combination with the endpoint to perform operationsassociated with generating the risk score for the user.
 2. The method ofclaim 1, further comprising: storing the enriched events correspondingto each of the plurality of events within a datastore.
 3. The method ofclaim 2, wherein: the enriching data comprises validating event dataassociated with at least some of the plurality of events, disclaimingcertain event data associated with at least some of the plurality ofevents; deduplicating at least some of the plurality of events;performing an entity resolution operation on at least some of theplurality of events; performing an attachment enrichment operation ondata associated with at least some of the plurality of events; and,performing a domain enrichment on at least some of the plurality ofevents.
 4. The method of claim 1, further comprising: labeling at leastsome of the plurality of events prior to extracting features from theplurality of events.
 5. The method of claim 1, wherein: the extractingfeatures comprises performing transformation operations on certainfeatures associated with an event to generate a smaller set of derivedfeatures.
 6. The method of claim 1, further comprising: processing aquery relating to the plurality of events, the processing the querybeing performed via a streaming query framework.
 7. The method of claim1, further comprising: performing a container summation operation usingcontents of the delta container, the container summation operation beingperformed as: $\Delta = {\sum\limits_{i = 1}^{n}{VAL}_{i}}$ whereVAL_(i) corresponds to a score value of an associated feature.
 8. Themethod of claim 7, further comprising: performing a scoring data updateoperation using the results of the scoring operation and the containersummation operation, the scoring data update operation being performedas:P ₃ ={circumflex over (P)} ₂+Δ where P₃ corresponds to a third point intime.
 9. A system comprising: a processor; a data bus coupled to theprocessor; and a non-transitory, computer-readable storage mediumembodying computer program code for performing a risk assessmentoperation, the non-transitory, computer-readable storage medium beingcoupled to the data bus, the computer program code interacting with aplurality of computer operations and comprising instructions executableby the processor and configured for: receiving a stream of data via aprotected endpoint of a plurality of protected endpoints, the stream ofdata representing electronically-observable interactions by a user, theelectronically-observable interactions being observed through at leastone of an electronic device, a computer system and a softwareapplication executing on the computing system, the protected endpointidentifying a plurality of events from the interactions by the user, atleast some of the plurality of events corresponding to user actions, theprotected endpoint comprising an endpoint device and an endpoint agent,the endpoint agent executing on a hardware processor of the endpointdevice, the protected endpoint providing a policy-based approach tonetwork security; enriching data associated with each of the pluralityof events to provide enriched data associated with each of the pluralityof events; extracting features from the plurality of events using theenriched data associated with each of the plurality of events;generating enriched events corresponding to each of the plurality ofevents based upon enriched data associated with each of the plurality ofevents and the features extracted from the plurality of events;performing a probability distribution operation on the enriched events,the probability distribution operation analyzing probabilitydistributions of the features extracted from the plurality of events,the probability distribution operation comprising a scoring containerupdate operation, the scoring container update operation using a scoringcontainer to provide an approximation of a probability distribution ofthe features from the plurality of events for a particular time windowacross a sequence of time windows, the scoring container beingimplemented as a percentile container and a delta container, thepercentile container collecting probability distribution of featuresextracted from certain interrelated events of a particular period oftime which are then used to perform scoring operations, the deltacontainer collecting probability distribution of features extracted fromcertain interrelated events of a particular period of time which arethen used to update a persistent datastore; performing a scoringoperation using contents of the percentile container, the scoringoperation being performed as:${\hat{P}}_{2} = {{\hat{P}}_{1} + {\sum\limits_{i = 1}^{n}{VAL}_{i}}}$where P₁ corresponds to a first point in time; P₂ corresponds to asecond point in time; and, VAL_(i) corresponds to a score value of anassociated feature; generating a risk score for the user based upon theenriched events and the probability distribution; and, performing therisk assessment operation via a security analytics system based upon theenriched events, the security analytics system executing on a hardwareprocessor, the risk assessment operation taking into account the riskscore, the plurality of protected endpoints communicating with thesecurity analytics system via a network, the security analytics systembeing implemented in combination with the endpoint to perform operationsassociated with generating the risk score for the user.
 10. The systemof claim 9, wherein the instructions are further configured for: storingthe enriched events corresponding to each of the plurality of eventswithin a datastore.
 11. The system of claim 10, wherein: the enrichingdata comprises validating event data associated with at least some ofthe plurality of events, disclaiming certain event data associated withat least some of the plurality of events; deduplicating at least some ofthe plurality of events; performing an entity resolution operation on atleast some of the plurality of events; performing an attachmentenrichment operation on data associated with at least some of theplurality of events; and, performing a domain enrichment on at leastsome of the plurality of events.
 12. The system of claim 9, wherein theinstructions are further configured for: labeling at least some of theplurality of events prior to extracting features from the plurality ofevents.
 13. The system of claim 9, wherein: the extracting featurescomprises performing transformation operations on certain featuresassociated with an event to generate a smaller set of derived features.14. The system of claim 9, wherein: processing a query relating to theplurality of events, the processing the query being performed via astreaming query framework.
 15. The system of claim 9, wherein theinstructions are further configured for: performing a containersummation operation using contents of the delta container, the containersummation operation being performed as:$\Delta = {\sum\limits_{i = 1}^{n}{VAL}_{i}}$ where VAL_(i) correspondsto a score value of an associated feature.
 16. The system of claim 15,wherein the instructions are further configured for: performing ascoring data update operation using the results of the scoring operationand the container summation operation, the scoring data update operationbeing performed as:P ₃ ={circumflex over (P)} ₂+Δ where P₃ corresponds to a third point intime.
 17. A non-transitory, computer-readable storage medium embodyingcomputer program code for performing a risk assessment operation, thecomputer program code comprising computer executable instructionsconfigured for: receiving a stream of events via a protected endpoint ofa plurality of protected endpoints, the stream of events comprising aplurality of events, at least some of the stream of events correspondingto user actions, the protected endpoint comprising an endpoint deviceand an endpoint agent, the endpoint agent executing on a hardwareprocessor of the endpoint device; enriching data associated with each ofthe plurality of events to provide enriched data associated with each ofthe plurality of events; extracting features from the plurality ofevents using the enriched data associated with each of the plurality ofevents; generating enriched events corresponding to each of theplurality of events based upon enriched data associated with each of theplurality of events and the features extracted from the plurality ofevents; performing a probability distribution operation on the enrichedevents, the probability distribution operation analyzing probabilitydistributions of the features extracted from the plurality of events,the probability distribution operation comprising a scoring containerupdate operation, the scoring container update operation using a scoringcontainer to provide an approximation of a probability distribution ofthe features from the plurality of events for a particular time windowacross a sequence of time windows, the scoring container beingimplemented as a percentile container and a delta container, thepercentile container collecting probability distribution of featuresextracted from certain interrelated events of a particular period oftime which are then used to perform scoring operations, the deltacontainer collecting probability distribution of features extracted fromcertain interrelated events of a particular period of time which arethen used to update a persistent datastore; performing a scoringoperation using contents of the percentile container, the scoringoperation being performed as:${\hat{P}}_{2} = {{\hat{P}}_{1} + {\sum\limits_{i = 1}^{n}{VAL}_{i}}}$where P₁ corresponds to a first point in time; P₂ corresponds to asecond point in time; and, VAL_(i) corresponds to a score value of anassociated feature; generating a risk score for the user based upon theenriched events and the probability distribution; and, performing therisk assessment operation via a security analytics system based upon theenriched events, the security analytics system executing on a hardwareprocessor, the risk assessment operation taking into account the riskscore, the plurality of protected endpoints communicating with thesecurity analytics system via a network, the security analytics systembeing implemented in combination with the endpoint to perform operationsassociated with generating the risk score for the user.
 18. Thenon-transitory, computer-readable storage medium of claim 17, whereinthe computer executable instructions are further configured for: storingthe enriched events corresponding to each of the plurality of eventswithin a datastore.
 19. The non-transitory, computer-readable storagemedium of claim 18, wherein: the enriching data comprises validatingevent data associated with at least some of the plurality of events,disclaiming certain event data associated with at least some of theplurality of events; deduplicating at least some of the plurality ofevents; performing an entity resolution operation on at least some ofthe plurality of events; performing an attachment enrichment operationon data associated with at least some of the plurality of events; and,performing a domain enrichment on at least some of the plurality ofevents.
 20. The non-transitory, computer-readable storage medium ofclaim 17, wherein the computer executable instructions are furtherconfigured for: labeling at least some of the plurality of events priorto extracting features from the plurality of events.
 21. Thenon-transitory, computer-readable storage medium of claim 17, wherein:the extracting features comprises performing transformation operationson certain features associated with an event to generate a smaller setof derived features.
 22. The non-transitory, computer-readable storagemedium of claim 17, wherein the computer executable instructions arefurther configured for: processing a query relating to the plurality ofevents, the processing the query being performed via a streaming queryframework.
 23. The non-transitory, computer-readable storage medium ofclaim 17, wherein the computer executable instructions are deployablefrom a server system at a remote location.
 24. The non-transitory,computer-readable storage medium of claim 17, wherein the computerexecutable instructions are provided by a service provider to a user onan on-demand basis.
 25. The non-transitory, computer-readable storagemedium of claim 17, wherein the computer executable instructions arefurther configured for: performing a container summation operation usingcontents of the delta container, the container summation operation beingperformed as: $\Delta = {\sum\limits_{i = 1}^{n}{VAL}_{i}}$ whereVAL_(i) corresponds to a score value of an associated feature.
 26. Thenon-transitory, computer-readable storage medium of claim 25, whereinthe computer executable instructions are further configured for:performing a scoring data update operation using the results of thescoring operation and the container summation operation, the scoringdata update operation being performed as:P ₃ ={circumflex over (P)} ₂+Δ where P₃ corresponds to a third point intime.